-- Logs begin at Thu 2022-08-04 20:01:44 UTC, end at Thu 2022-08-04 21:17:26 UTC. -- Aug 04 20:44:47.187961 dv-cinder-836027-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 20:44:47.195138 dv-cinder-836027-4-smb devstack@keystone.service[80205]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 20:44:47 2022] *** Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: nodename: dv-cinder-836027-4-smb Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: machine: x86_64 Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: clock source: unix Aug 04 20:44:47.197253 dv-cinder-836027-4-smb devstack@keystone.service[80205]: pcre jit disabled Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: detected number of CPU cores: 4 Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: current working directory: / Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: detected binary path: /usr/bin/uwsgi-core Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: your processes number limit is 47680 Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: your memory page size is 4096 bytes Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: detected max file descriptor number: 2048 Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: lock engine: pthread robust mutexes Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: thunder lock: enabled Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 20:44:47.197715 dv-cinder-836027-4-smb devstack@keystone.service[80205]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 20:44:47.238381 dv-cinder-836027-4-smb devstack@keystone.service[80205]: Python main interpreter initialized at 0x557e90bf59c0 Aug 04 20:44:47.238381 dv-cinder-836027-4-smb devstack@keystone.service[80205]: python threads support enabled Aug 04 20:44:47.238381 dv-cinder-836027-4-smb devstack@keystone.service[80205]: your server socket listen backlog is limited to 100 connections Aug 04 20:44:47.238381 dv-cinder-836027-4-smb devstack@keystone.service[80205]: your mercy for graceful operations on workers is 90 seconds Aug 04 20:44:47.238783 dv-cinder-836027-4-smb devstack@keystone.service[80205]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 20:44:47.238860 dv-cinder-836027-4-smb devstack@keystone.service[80205]: *** Operational MODE: preforking *** Aug 04 20:44:47.239101 dv-cinder-836027-4-smb devstack@keystone.service[80205]: *** uWSGI is running in multiple interpreter mode *** Aug 04 20:44:47.239101 dv-cinder-836027-4-smb devstack@keystone.service[80205]: spawned uWSGI master process (pid: 80205) Aug 04 20:44:47.239308 dv-cinder-836027-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 20:44:47.239890 dv-cinder-836027-4-smb devstack@keystone.service[80205]: spawned uWSGI worker 1 (pid: 80217, cores: 1) Aug 04 20:44:47.240227 dv-cinder-836027-4-smb devstack@keystone.service[80205]: spawned uWSGI worker 2 (pid: 80218, cores: 1) Aug 04 20:44:47.240384 dv-cinder-836027-4-smb devstack@keystone.service[80205]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 20:44:52.713037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:44:52.713037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: from cryptography.utils import int_from_bytes Aug 04 20:44:52.713886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:44:52.713886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes Aug 04 20:44:52.714324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:44:52.714324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: from cryptography.utils import int_from_bytes Aug 04 20:44:52.714435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 20:44:52.714435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: from cryptography.utils import int_from_bytes Aug 04 20:44:52.763027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:44:52.763245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:44:52.763400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] command line args: [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:44:52.763673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:44:52.764467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ================================================================================ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:44:52.764778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] admin_token = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.765032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] config_dir = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.765224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.765409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] config_source = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.765597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] debug = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.765798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.766153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 20:44:52.766252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.766362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.766445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 20:44:52.766548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] command line args: [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 20:44:52.766626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.766813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 20:44:52.766936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ================================================================================ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 20:44:52.767138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_config_append = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] config_dir = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_dir = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.767924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] config_source = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] debug = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768860 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.768860 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_config_append = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.769931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_dir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.770969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.771857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] publish_errors = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.772984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] standard_threads = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] use_journal = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.773956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] use_json = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] publish_errors = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] use_stderr = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] use_syslog = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.774837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.774958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.775047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.775196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.775276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.775434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] standard_threads = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.775525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.775671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.775791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.775948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.776130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.776340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] use_journal = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] use_json = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.776649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] use_stderr = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.776808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] use_syslog = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.776967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 20:44:52.777221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.777953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.778939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.779976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.780999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.781974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.782933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.783925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.784875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.785910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.786966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.787936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.788895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.789968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.790990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.791970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.792930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.793904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.794846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.795888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.796999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.797933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.798977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.799967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.external = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.800928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.password = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] auth.token = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.801915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.external = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.802861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803013 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.password = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] auth.token = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.803888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.804826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.805988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.806991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.807863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.808999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.809984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.810068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.810221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.810303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.810474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.810558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.811995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.812966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.813921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.814974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.815983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.816932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.817917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.818887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.819999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.820972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.821921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.822965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.823970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.824932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.825874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.826027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.826111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.826329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.826945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.827982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.828954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.829929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.830920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.831909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.832873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.833850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.834983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] role.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] role.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.835995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.836980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] role.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.837958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] role.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.838937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.839887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.840875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.841976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.842994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843236 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.843971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.844931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.845999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.846963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.847960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.848967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.849912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.850870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.851876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.852911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:44:52.852986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.853226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.853468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.853718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.853962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.854215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.854457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.854707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.854944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.855189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.855430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 20:44:52.855601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 20:44:52.882050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.882282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.882512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.884042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.884281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.884511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.891393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.893413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.921441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.921669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.923370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.923607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.973643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:52.974032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.023657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.023917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.024368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.024610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.088438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.088668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.088891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.088983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.089113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.089291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.089376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.089537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.089676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.090060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.090445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.090835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.113197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.113432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.113657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.113910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.114091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.114306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.114520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.114929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.115185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.115412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.115635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.115882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.116098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.116396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.126223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.128152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.138933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.139932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80218) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.140708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 20:44:53.157009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.157220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 20:44:53.157312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.157511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 20:44:53.157601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.157745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 20:44:53.157847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 20:44:53.158282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.158886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.159046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.168752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.169837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.177009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.177318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.181722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.182008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.182293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.182954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.183956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.184757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.207980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.208251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.209468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.209745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.209839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.210029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.214362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.214647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.214737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.214930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.215021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.215213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.221659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.221890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.221981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.222181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.226093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.226338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.226429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.226621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.226712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.226911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.227884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.228073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.228164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.228344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.244635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.244920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.245201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.245485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.249421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.249996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.252593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.252891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.253197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.253496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.257279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.257929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.260489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.261139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.263634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.263986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.264955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.265153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.265244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.265472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.265753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.281650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.281934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.282205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.282354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.282473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.282655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.282930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.283201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.289655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.290414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.291203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.291481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.292009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.292292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.294341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.294624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.294923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.295696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.295843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.296009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.296146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.296308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.296603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.296879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.307480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.307772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.308061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.308346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.308478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.308625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.308756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.308898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.309989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.324785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.325636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.327822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.328675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.330769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.331603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.333370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.334209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.334890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.335196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.335480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.335723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.336074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.336376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.342469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.343359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.344101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.345004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.347045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.347337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.347623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.347927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.348013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.348235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.348523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.348804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.355971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.356263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.356546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.356868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.357161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.357447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.363965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80218) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.364249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.364533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.364812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.364908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 20:44:53.365087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.365920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.366913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80218) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.367886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.368165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.368434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.368709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 20:44:53.401062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e90bf59c0 pid: 80218 (default app) Aug 04 20:44:53.404034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e90bf59c0 pid: 80217 (default app) Aug 04 20:44:53.405029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6c28c-1a1b-47f8-9a99-afecba8d8a79 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:44:53.405323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6c28c-1a1b-47f8-9a99-afecba8d8a79 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:44:53.405600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6c28c-1a1b-47f8-9a99-afecba8d8a79 None None] PATH_INFO: `/v3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:44:53.409946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu Aug 4 20:44:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:01.031030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:01.031613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:01.031613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:01.036332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:01.041677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:01.042085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:01.042225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:01.111580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: INFO dbcounter [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] Registered counter for database keystone Aug 04 20:45:01.131191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:45:01.137752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writer thread running {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:45:01.314986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG passlib.handlers.bcrypt [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80218) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 20:45:01.315317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG passlib.handlers.bcrypt [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80218) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 20:45:01.368728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:01.370329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:01.500378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 20:45:01.635945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:01.704676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: INFO dbcounter [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] Registered counter for database keystone Aug 04 20:45:01.726238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG oslo_db.sqlalchemy.engines [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 20:45:01.732398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writer thread running {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 20:45:01.849897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a25f16-faa8-438e-9d07-880f4f833d0b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:01.854185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:01.854829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:01.855115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:01.855389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:01.863411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:01.915000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 20:45:01.915348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d1444-928c-4854-81be-924cc52f4edc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:01.925256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Aug 4 20:45:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 20:45:01.931177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:01.946257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b69b9-fb45-481b-9b27-1f56451d25ba None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:01.950720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:01.951870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:01.952156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:01.952430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] PATH_INFO: `/v3/projects/e33293e6de544d599e97bfb77454f460` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:01.953918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] RBAC: Authorizing `identity:get_project(project_id=e33293e6de544d599e97bfb77454f460)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:02.003813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 20:45:02.004165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42286-088d-4133-a4bd-38797c08d470 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:02.008917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu Aug 4 20:45:01 2022] GET /identity/v3/projects/e33293e6de544d599e97bfb77454f460 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:03.976677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560952-2ab6-4bda-a47f-7049a2ab179c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:03.977219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560952-2ab6-4bda-a47f-7049a2ab179c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:03.977219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560952-2ab6-4bda-a47f-7049a2ab179c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:03.981346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:03.987174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:03.987564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:03.987736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:04.007221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:04.008780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:04.016529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 20:45:04.038418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560952-2ab6-4bda-a47f-7049a2ab179c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:04.050635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560952-2ab6-4bda-a47f-7049a2ab179c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:04.054774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:04.055368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:04.055846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:04.056128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:04.063609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:04.065423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df379ad-0f20-4c74-b1de-fe2ac108eb71 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:04.073896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Aug 4 20:45:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 20:45:04.079229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:04.088614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15022a-5c0e-451c-85b0-e27d7d1fe393 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:04.093501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:04.094137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:04.094419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:04.094694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:04.096087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:04.097914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84aa0-8b48-4f60-a8b2-6f050e462308 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:04.099451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu Aug 4 20:45:04 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:06.136052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0773a2-fece-4366-8e0f-08996a418a98 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.136612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0773a2-fece-4366-8e0f-08996a418a98 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.136612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0773a2-fece-4366-8e0f-08996a418a98 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.137984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:06.143298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.143716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.143955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.163580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:06.164816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:06.193385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8979a-a46b-465a-88bd-289c25796fa1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.193671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8979a-a46b-465a-88bd-289c25796fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.193949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8979a-a46b-465a-88bd-289c25796fa1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.195287 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:06.200324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.200612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.200889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.243858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80217) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 20:45:06.244274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG passlib.handlers.bcrypt [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80217) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 20:45:06.245314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:06.271691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.291143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:06.292792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:06.296482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.379431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba88f48-bce1-4bfd-93b9-364d9958fa84 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.393723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:06.413497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.414139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.414430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.414732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.415505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.425855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:06.434616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:06.435600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:06.436724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:06.441678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.514949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494636-c6e0-4c76-ad26-e5cc33c343c0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.517237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.522367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.543105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531450c-8e6a-433c-beac-ad7e951e6f1a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.556324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.557196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.557480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.557818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.576485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.577106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.577390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.577666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.578393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:06.578698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:06.580124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:06.592094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:06.597530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.624679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:06.626213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:06.725234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:45:06.731329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.735004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.803414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b858a-2817-4144-a73d-e48f5820356d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.833159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bf68e-5448-4e73-b77f-f93b7a75cd55 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.837331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.838003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.838285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.838560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.839731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:06.841735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:06.843329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:06.848624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.863446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.867255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.868253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.868537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.868813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.887258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:06.888749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:45:06.907317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:06.908247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:06.909088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:45:06.909088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:45:06.909088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:45:06.909088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:06.909088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:06.914473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:06.951636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ba4-e7a4-44bf-b8c1-1378ad7a4994 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:06.979117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:06.986450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:06.987104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:06.987391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:06.987670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:06.988873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:06.990346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:06.991973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:06.997757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:07.023173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3a30-56db-4949-8cfd-1f0da2e127c3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:07.061383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:07.062009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:07.062295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:07.062576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:07.063295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:07.063591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:07.065026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a3b76-4782-45a5-ab07-9072cf63b8de None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:07.077757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:07.082473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:07.098585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872f9d-bc51-4cd7-8f54-2ae6f166c3c0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:07.135165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:07.135846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:07.136133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:07.136411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:07.137230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.domain.id=default, user.id=324f5132b96b4ed6a03451226e91b982) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:07.137543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:07.139590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404705f-c122-4488-b34f-8e6c13b01ee3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:07.147192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Aug 4 20:45:06 2022] GET /identity/v3/role_assignments?user.id=324f5132b96b4ed6a03451226e91b982&scope.domain.id=default&role.id=c757366a629b447b93eff207471f3401 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:09.579364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd315ba-0441-446d-8e22-4063a0cfedb3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:09.579904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd315ba-0441-446d-8e22-4063a0cfedb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:09.579976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd315ba-0441-446d-8e22-4063a0cfedb3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:09.585146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:09.598974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:09.599478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:09.599577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:09.628927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:09.630154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:09.741747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:09.770350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930a68-e6fc-4d2d-a194-34eb29fc91b7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:09.770646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930a68-e6fc-4d2d-a194-34eb29fc91b7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:09.770914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18930a68-e6fc-4d2d-a194-34eb29fc91b7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:09.772311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:09.777699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:09.801686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e97f-5422-4dc5-a0d0-71f2e5f36246 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:09.802182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e97f-5422-4dc5-a0d0-71f2e5f36246 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:09.802662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e97f-5422-4dc5-a0d0-71f2e5f36246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:09.843334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-84a6e97f-5422-4dc5-a0d0-71f2e5f36246 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:09.844625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-84a6e97f-5422-4dc5-a0d0-71f2e5f36246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:09.960195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.008878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54360ca-2bd0-4da4-8b79-42c88e1ed733 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.012697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:10.014052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d606b-a7b8-43d4-a9be-97c72cece904 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.014340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d606b-a7b8-43d4-a9be-97c72cece904 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.014729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d606b-a7b8-43d4-a9be-97c72cece904 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.026312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:10.032490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.032798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.033216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.071964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:10.073172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:10.107688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.108365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.108649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.108929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.129452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:10.136035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:10.136882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:10.137658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:10.139463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:10.152840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.156129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.182778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:10.184081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.293801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321ec5-2ed1-48a2-a613-7ab713198643 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.335322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.335999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.336289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.336713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.337588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:10.339048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ec4b5-447b-4d77-a664-bd5f46cab2fe None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:10.343151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.423623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7a2b-bcc6-4777-9fcd-e6ef7c805a37 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.471321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.472283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.472760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.473222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.474145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:10.474638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:10.476339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09bd3d-1c49-4a0c-849b-661d94d21478 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:10.483617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 14/29] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 4 20:45:10 2022] POST /identity/v3/roles => generated 219 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:10.485200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae3-c022-4665-9ad9-43ab8654200c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.485496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae3-c022-4665-9ad9-43ab8654200c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.485782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae3-c022-4665-9ad9-43ab8654200c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.491171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:10.491171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2ae3-c022-4665-9ad9-43ab8654200c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.496922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:10.499190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.499667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.500176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.526127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:10.527844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:10.604930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.676331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2ae3-c022-4665-9ad9-43ab8654200c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.678733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 17/32] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:10.679431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.716716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.717382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.717732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.718008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.718737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:10.720373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:10.741253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 16/33] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 4 20:45:10 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:10.741772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.811491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45876d8-3795-49bc-b590-40ef1ad12891 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.813952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.851144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.851838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.852130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.852415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.854067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:10.855628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:10.858130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 18/34] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:10 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:10.863329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:10.869429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcc4ac-ba5f-40dc-a596-b94c434f4d96 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.901941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:10.913167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:10.913846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.914295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.914580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.931201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:10.933315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a666ee19-8228-46d8-b685-c2c1354c81d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:45:10.954166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:10.955077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:10.956196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:45:10.956196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:45:10.956196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:45:10.956196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:10.956196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 17/35] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:10.959688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371539a-2282-447b-966c-cf05717b2fee None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.959688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371539a-2282-447b-966c-cf05717b2fee None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.959688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371539a-2282-447b-966c-cf05717b2fee None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.959688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:10.964812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:10.965094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:10.965376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:10.982045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284542bb-e896-4af3-a432-a67b3bf489f2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:10.987229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:10.989708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:11.030340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.031783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.031783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.031783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.034004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.035474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.037772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 19/37] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:11.038430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.076992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:11.077654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.120374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:11.150676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08618-f207-4643-aa60-3eaaa8ee4c88 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.152955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:11.186509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80a0df-4ed4-4144-b865-79564a790f39 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.187004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.187636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.187970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.188251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.188955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:11.189265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.190649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a695c-e3c5-423f-beeb-aa9249da0574 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.202228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 20/39] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:11.204991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d6e5-9487-403f-bc07-4eb85b7b63f3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.205279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d6e5-9487-403f-bc07-4eb85b7b63f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.205554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59d6e5-9487-403f-bc07-4eb85b7b63f3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.206959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 21/40] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:11.208627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59d6e5-9487-403f-bc07-4eb85b7b63f3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.220257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.220940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.221228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.221509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] PATH_INFO: `/v3/domains/default/users/324f5132b96b4ed6a03451226e91b982/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.223491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=324f5132b96b4ed6a03451226e91b982, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.224992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.239578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1361 bytes} [Thu Aug 4 20:45:11 2022] PUT /identity/v3/domains/default/users/324f5132b96b4ed6a03451226e91b982/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:11.240536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.334476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59d6e5-9487-403f-bc07-4eb85b7b63f3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.355359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:11.364474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13944f37-9b0e-4d54-8125-ee9a2df8a67b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.374078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.374802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.375175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.375522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.376786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.378252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2da285-515d-4a24-8600-a6065cb6ce78 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.380533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 22/42] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:11.381525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc118b6-f05e-4872-958c-123334d1608e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.381853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc118b6-f05e-4872-958c-123334d1608e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.382165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc118b6-f05e-4872-958c-123334d1608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.402853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-adc118b6-f05e-4872-958c-123334d1608e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:11.404661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-adc118b6-f05e-4872-958c-123334d1608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:11.418021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.418651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.418989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.419801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.420513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.421970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.434820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:11.451768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:45:11 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:11.452603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.507039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 23/44] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:11.532730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc118b6-f05e-4872-958c-123334d1608e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:11.596318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89caac-ab02-4664-b532-aa332ec6078a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.642492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.643437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.643911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.644201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.644904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.646429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee166e-394d-46de-9553-bfceaff749c5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.669989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc118b6-f05e-4872-958c-123334d1608e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:11.673619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:11.687798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:45:11 2022] POST /identity/v3/projects => generated 312 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:11.718091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:11.718750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:11.719037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:11.719369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:11.720206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:11.721758 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc1bef-5a62-4acb-a73e-bd3ab3ad0203 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:11.849650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 4 20:45:11 2022] POST /identity/v3/roles => generated 223 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:45:13.242262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abccda-013a-45b1-9a68-19ce3107248c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.242823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abccda-013a-45b1-9a68-19ce3107248c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.242823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abccda-013a-45b1-9a68-19ce3107248c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.244195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 23/47] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:13.250077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.250488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.250765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.269156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:13.270661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:13.286977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:13.338176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 25/48] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:13.361174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abccda-013a-45b1-9a68-19ce3107248c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.464852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abccda-013a-45b1-9a68-19ce3107248c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:13.498258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:13.498822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.499166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.499444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.509640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:13.514604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:13.515439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:13.516343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 24/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:13.523455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.622053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86702b0f-453d-475a-8fd0-59c2fc4c9e13 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:13.655448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:13.656099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.656387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.656667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.657400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:13.657713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:13.659237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e67c45-4cfd-45eb-8237-47f323a64f8a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:13.667511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 26/50] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:13.673834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.697507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5ed5-cad2-4f21-bcc3-3bf0cb7244c1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.697806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5ed5-cad2-4f21-bcc3-3bf0cb7244c1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.698087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5ed5-cad2-4f21-bcc3-3bf0cb7244c1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.699439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 27/51] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:13.704410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.704706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.704991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.723220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:13.724512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:13.734411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:13.734575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:13.792040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b6287-de05-48de-834d-f03198b11b40 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:13.808742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 28/52] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:13.825235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:13.825888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.826176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.826462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.827650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:13.830818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:13.831177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.832619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 25/53] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:13.837701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.928899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36363af3-3d48-47e9-b9b4-c34a44d62dff None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:13.935755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cdcdf-76a4-43f2-9dcb-425014eb1001 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:13.960410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:13.962704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:13.963469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.963770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.964089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.965315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:13.966862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:13.968080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:13.968529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 29/54] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:13.968722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:13.969007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:13.969284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:13.970444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:13.971918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:13.978135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 26/55] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:13.978270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.979045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:13.989086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:14.072779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8feb8-aee0-468c-9389-1ced1aa95cec None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:14.078221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d7a58-4766-4e75-b5b6-000da68f1f40 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:14.107110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:14.107737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:14.108055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:14.108337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:14.109026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:14.112101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0457e9-1649-4615-acc8-5dc5cbb41c66 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:14.116743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:14.117686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:14.118197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:14.118723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:14.119887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.domain.id=default, user.id=324f5132b96b4ed6a03451226e91b982) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:14.120473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:14.123545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570a758-b963-4e33-b7f7-23db41a5942e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:14.130095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 27/56] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Aug 4 20:45:13 2022] GET /identity/v3/role_assignments?user.id=324f5132b96b4ed6a03451226e91b982&scope.domain.id=default&role.id=c757366a629b447b93eff207471f3401 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:14.147932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Aug 4 20:45:13 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:45:16.166861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ae64-f6e0-4225-94e6-66c93493136d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:16.167396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ae64-f6e0-4225-94e6-66c93493136d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:16.167396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2ae64-f6e0-4225-94e6-66c93493136d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:16.169335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:16.174635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:16.175054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:16.175201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:16.193463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:16.194656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:16.251367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:16.260555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:16.284687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2ae64-f6e0-4225-94e6-66c93493136d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:16.343934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:16.385202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2ae64-f6e0-4225-94e6-66c93493136d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:16.417249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:16.417826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:16.418115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:16.418399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:16.423038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:16.424543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c02f50-7823-42bf-a0cd-f7093cc75fcf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:16.426164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:16.431735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:16.532691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f7851-3864-450e-adac-b3c500cc7a2f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:16.566007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:16.566650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:16.566941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:16.567225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:16.567974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:16.569459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382c7e-e557-425b-b5d9-30a25765b607 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:16.596572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:16 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:45:19.674719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e114e-d62f-4a61-8de5-4e23b945e4ba None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:19.675568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e114e-d62f-4a61-8de5-4e23b945e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:19.676046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e114e-d62f-4a61-8de5-4e23b945e4ba None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:19.677828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:19.683009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb7e0-1cf0-48bb-be8f-2fbf09f9c726 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:19.683797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb7e0-1cf0-48bb-be8f-2fbf09f9c726 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:19.684771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bb7e0-1cf0-48bb-be8f-2fbf09f9c726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:19.707461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cf0bb7e0-1cf0-48bb-be8f-2fbf09f9c726 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:19.708942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf0bb7e0-1cf0-48bb-be8f-2fbf09f9c726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:19.766413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:19.800624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:19.857962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e114e-d62f-4a61-8de5-4e23b945e4ba None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:19.944812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f582-95bb-4bfb-b654-9c1685a11b6d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:19.945156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f582-95bb-4bfb-b654-9c1685a11b6d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:19.945381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f582-95bb-4bfb-b654-9c1685a11b6d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:19.946749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 34/64] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:19.952351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:19.952654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:19.952941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:19.984174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:19.985429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:20.041863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e114e-d62f-4a61-8de5-4e23b945e4ba None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.068429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 35/65] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:20.086364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.097179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.097843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.098131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.098412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.110045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.120608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:20.127158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:20.128091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:20.128968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 31/66] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:20.136674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.233884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe791df-c8cb-4380-ba33-bf1c4f1addb3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.244865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.270703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.271345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.271626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.271943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.281808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2471b-673e-43e7-831b-e2565699cb30 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.283371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3b38b66f-e5c1-4787-8607-e94c0a6b06d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:20.291059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:20.292033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 36/67] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:20.294303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae88c-14e2-4f86-bb5a-2596954860c6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.295003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae88c-14e2-4f86-bb5a-2596954860c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.295003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ae88c-14e2-4f86-bb5a-2596954860c6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.295966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 37/68] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:20.299927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21116-6ac8-4421-98e9-25a8d7c8eba1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.299927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21116-6ac8-4421-98e9-25a8d7c8eba1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.299927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21116-6ac8-4421-98e9-25a8d7c8eba1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.299927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 38/69] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:20.299927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ea5a-317b-4dfa-9afb-095660f8957a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.300250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ea5a-317b-4dfa-9afb-095660f8957a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.300250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ea5a-317b-4dfa-9afb-095660f8957a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.301604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 39/70] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:20.304015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ea5a-317b-4dfa-9afb-095660f8957a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.324988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.325613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.325895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.326170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.326881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:20.327189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:20.328623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3ce2f-236d-43f7-9f91-dcbcdeeae59f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:20.336846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 32/71] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:20.338051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8627a-e6de-49ee-b72b-b7a49f9b0c53 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.338343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8627a-e6de-49ee-b72b-b7a49f9b0c53 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.338624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8627a-e6de-49ee-b72b-b7a49f9b0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.357207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-83c8627a-e6de-49ee-b72b-b7a49f9b0c53 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:20.358439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-83c8627a-e6de-49ee-b72b-b7a49f9b0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:20.404646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.410002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ea5a-317b-4dfa-9afb-095660f8957a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.427146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 33/72] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:20.428418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.428704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.428983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.446024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:20.447211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:20.453710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.454335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.454619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.454891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.455608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:20.455947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:20.457341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942459-7365-4262-a3a6-a13465926528 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:20.466171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 40/73] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:20.467368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.467660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.467967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.485258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:20.486435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:20.511981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.516731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 34/74] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:20.517735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.563846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 41/75] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:20.564628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.623821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292c35d-904e-4386-a96e-550a0a4755e2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.634440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.658576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.659213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.659492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.659796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.662709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbe239-dda1-486e-b8c1-0268acd42dc1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.673005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:20.674463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:20.676131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 35/76] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:20.676886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.700835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.701496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.701788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.702074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.712194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:20.717790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:20.718691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 42/77] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:20.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.746988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.778515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9f52-b70d-431a-abd3-1811b3c19c4b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.811809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.812451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.812747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.813023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.814263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:20.815654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:20.817455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 36/78] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:20.818029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.826085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e137-9d54-4e9e-bbab-1fd9e7ad7231 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.852567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.860320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.860974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.861260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.861537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.862712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:20.864217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:20.865826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 43/79] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:20.866597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:20.920345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d375fa-df59-4f32-832d-ce9a6313a628 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.953348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:20.953990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:20.954268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:20.954546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:20.961357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:20.965323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:20.970768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:20.971901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:20.972877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 37/80] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:20.973702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4f382-d130-43c1-a039-ed452aa1d459 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:20.973782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.007162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.007817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.008104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.008382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.068900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.074423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.075561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9077cd8-1593-4a05-a15e-364232990af0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.075958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.110877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.111496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.111889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.112174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.112895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:21.113205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.114626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.122587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 38/81] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.123379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.172405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.183602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 44/82] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:21.184317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.226514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8dbc4-5be8-4ab0-a571-a31c2401f54d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.259210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.259861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.260152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.260521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.281830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e13d-223a-495b-b203-4078ea4bf5fc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.287058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.315369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.316012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.316294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.316575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.317252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.319008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.328691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.330171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.338938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 45/83] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:21 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:21.339763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.392991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.450319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 39/84] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:21.456012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.456310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876e6bd-554a-41ba-bf04-e104de24a30f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.505947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.505947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.506271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.506356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.507040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:21.507348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.508796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.522341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 46/85] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.527218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.534084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.581934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac0fb9-2f60-478d-aea4-51c13ba6fa62 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.626309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.627205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.628054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.628489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.630265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.632041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.634145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 40/86] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.635407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.657744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63297dd-79c3-472a-bb72-f0b5a3045b67 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.668238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.694990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.696159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.696448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.696730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.697933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.699418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.702573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 47/87] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.703438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.767265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d841-e811-465f-a4bf-e23b9d1b54a8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.799585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.812114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.813042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.813326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.813603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.815441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.816955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.819589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 41/88] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.824487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.835159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd84310-d292-4597-952d-2d992b735a1a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:21.875065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:21.875725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:21.876029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:21.876307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:21.877506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:21.879492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:21.882252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 48/89] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:21.883045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:21.947325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:21.951736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd126a1e-c516-424f-884f-f06afe2b6272 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.000564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.001604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.001895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.002450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.007020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996129d-12e7-4778-87da-abb50887bab4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.047170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.047842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.048131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.048408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.049208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:22.050048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.051541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.062906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 49/90] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:22.063731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:22.076765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:22.088533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.089971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.178296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2b4d0-580f-44a4-a3e1-a91e6c97a2a3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.189070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:22.222428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 42/91] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:22.222723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.223308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:22.223499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.223643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.223917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.224726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=324f5132b96b4ed6a03451226e91b982) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:22.225040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.227865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.239868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 50/92] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/role_assignments?user.id=324f5132b96b4ed6a03451226e91b982&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:22.241968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:22.373248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:22.381139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733238d4-db27-4b39-a7e5-cab824a67fc8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.466955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181a4d-2c1b-4e6d-8be7-697b5e5804ca None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.494390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.495042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.495327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.495601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.507395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.508090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.508381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.509594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.510807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.513296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.514988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 51/93] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:22.525360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:22.597946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:22.631869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.633272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.706243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f80cca-5f0b-4cc5-b17b-d4818a7a290e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.730831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:22.739330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 43/94] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:22.745300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:22.784098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.784725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.785009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.785284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.786346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:22.786657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.788252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.803349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 52/95] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:22.874875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36470-9cd6-4702-9547-19caa4d48b21 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:22.917401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:22.918094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:22.918532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:22.918814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] PATH_INFO: `/v3/projects/58984c118bd645d3b118babe7129471a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:22.920231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] RBAC: Authorizing `identity:get_project(project_id=58984c118bd645d3b118babe7129471a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:22.921784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47e108-e5a7-498d-af0d-ead9230b833d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:22.923549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 44/96] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/projects/58984c118bd645d3b118babe7129471a => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:22.929860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:23.061253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abedd9-aad9-4200-9060-a9d61d509aeb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:23.068774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:23.109038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:23.109661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:23.109942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:23.110219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:23.111023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=58984c118bd645d3b118babe7129471a, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:23.111335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:23.112824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6caed9f-9d1c-471f-98f9-c0302c3de63f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:23.124188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 53/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:22 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=58984c118bd645d3b118babe7129471a&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:24.165241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62ec5-bda4-4c4f-b196-f3aeff049650 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.165760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62ec5-bda4-4c4f-b196-f3aeff049650 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.165864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62ec5-bda4-4c4f-b196-f3aeff049650 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.167430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 45/98] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:24.183204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e1c2-0a6e-4d1c-a4e6-c7ba8ece33fd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.183665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e1c2-0a6e-4d1c-a4e6-c7ba8ece33fd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.183879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e1c2-0a6e-4d1c-a4e6-c7ba8ece33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.208794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1208e1c2-0a6e-4d1c-a4e6-c7ba8ece33fd None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:24.210053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1208e1c2-0a6e-4d1c-a4e6-c7ba8ece33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:24.278933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 54/99] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:24.311155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d62ec5-bda4-4c4f-b196-f3aeff049650 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:24.353748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9eff8-9c61-44d9-902a-6a55ccf448aa None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.354041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9eff8-9c61-44d9-902a-6a55ccf448aa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.354313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9eff8-9c61-44d9-902a-6a55ccf448aa None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.355862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 55/100] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:24.360896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.361185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.361467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.396808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:24.398383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:24.412208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:24.477724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d62ec5-bda4-4c4f-b196-f3aeff049650 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:24.514135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:24.514799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.515092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.515379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.526147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:24.531250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:24.532150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:24.533189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 46/101] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:24.541428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:24.585432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 56/102] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:24.635078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:24.694069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:24.764155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee6bc4-c60d-4681-bdcb-730604594d08 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:24.807233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:24.827074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47ee3f-8fb6-4e6a-b406-f1b2048cda71 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:24.829052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:24.829623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.829914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.830199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.831357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:24.831357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:24.832667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7a870-2dc2-45bd-8681-b87c64934362 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:24.849655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 47/103] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:24.850982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b7c3f-315f-4dfd-ac8e-a253b7408f43 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.851281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b7c3f-315f-4dfd-ac8e-a253b7408f43 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.851565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b7c3f-315f-4dfd-ac8e-a253b7408f43 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.852828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 48/104] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:24.857084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b7c3f-315f-4dfd-ac8e-a253b7408f43 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:24.872555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:24.873555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.874058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.874521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.876030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:24.877676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee92bf-655d-4559-b123-6668e96f0e5f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:24.879539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 57/105] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:24.885275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:24.885767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:24.886261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:24.906230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:24.907720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:24.980865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 58/106] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:24.984896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.032372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.037588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b7c3f-315f-4dfd-ac8e-a253b7408f43 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.082545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203602-a271-410b-8117-36fae7a0180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.083853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203602-a271-410b-8117-36fae7a0180f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.083853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203602-a271-410b-8117-36fae7a0180f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.083853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203602-a271-410b-8117-36fae7a0180f None admin] PATH_INFO: `/v3/users/859664c5f4044def97048c9ef4f4e82e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.098547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96203602-a271-410b-8117-36fae7a0180f None admin] RBAC: Authorizing `identity:get_user(user_id=859664c5f4044def97048c9ef4f4e82e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.100197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96203602-a271-410b-8117-36fae7a0180f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.101950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 49/107] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:24 2022] GET /identity/v3/users/859664c5f4044def97048c9ef4f4e82e => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:25.102722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203602-a271-410b-8117-36fae7a0180f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.117551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6065-46ce-411d-bb3e-94a3dfa276b2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.147678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.158411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.159668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.160186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.160895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.161873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.163764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.203052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 59/108] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:45:24 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:25.204949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.209958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203602-a271-410b-8117-36fae7a0180f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.252713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.253392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.253682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.253965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.267599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:25.273728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:25.274604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:25.275816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 50/109] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:25.281724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.310940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.338121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043ef7a-2b8e-4865-88a5-719f59a06937 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.377222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.378238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.378739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.379205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.417019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d895c-17d1-4449-b3f9-3373d54e8dbc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.436200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.464622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.465350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.465651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.466324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.467074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:25.467460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.468965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.479638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 51/110] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:25.487175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.493400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.495199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13973a9-44de-4d55-8238-029ef5474adc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.582999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.615553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 60/111] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:25.618093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf945c-ccae-4a52-ab9b-c5b51d22506b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.619821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf945c-ccae-4a52-ab9b-c5b51d22506b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.619821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf945c-ccae-4a52-ab9b-c5b51d22506b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.624402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 61/112] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:25.625764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf945c-ccae-4a52-ab9b-c5b51d22506b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.629402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555388d7-fd45-4d07-8992-3d2eb3879d55 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.674685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.675736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.676269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.676760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.678263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.680056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3a7b8-ad27-4902-a239-b2403a6e774b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.682358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 52/113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:25.684222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.684783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.685310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.705175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:25.706671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:25.736035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.750021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf945c-ccae-4a52-ab9b-c5b51d22506b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.791952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 53/114] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:25.792770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.793499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.793728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.793850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.794055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.795327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.796955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.803384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 62/115] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:25.804728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.854686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:25.910833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce050ad-b7e9-441e-a619-54305b822090 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.925150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846ce6-ae63-42e6-a21a-123039bee9ca None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:25.948390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.949166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.949442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.949726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.950534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=859664c5f4044def97048c9ef4f4e82e) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:25.950847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.952361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.958956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 63/116] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/role_assignments?user.id=859664c5f4044def97048c9ef4f4e82e&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=7b09ac164cd440d28db6819fea31d58f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:25.963838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:25.972948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:25.974169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.975639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.976462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.983791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:25.985665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bfd62-6268-4f20-b704-77edab59be40 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:25.987772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 54/117] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:25.989746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9e92-92fb-4760-8697-7a7fa647fdec None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:25.992205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9e92-92fb-4760-8697-7a7fa647fdec None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:25.992689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c9e92-92fb-4760-8697-7a7fa647fdec None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:25.994498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 55/118] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:25.997331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9e92-92fb-4760-8697-7a7fa647fdec None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.039081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.159735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c9e92-92fb-4760-8697-7a7fa647fdec None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.185507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1b394-07c3-4c79-bcb0-93a6ee85c9cd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.203676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.204385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.204667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.204944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/c69133dfb93e42eea2175539531bcb21/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.207866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.208311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, user_id=c69133dfb93e42eea2175539531bcb21, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:26.209832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269222db-6287-4c31-9f66-b11d9515c4bd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:26.232857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 56/119] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:25 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/c69133dfb93e42eea2175539531bcb21/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:26.236554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1249147-49a1-4d60-8bad-3bef33019347 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.237582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1249147-49a1-4d60-8bad-3bef33019347 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.237851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1249147-49a1-4d60-8bad-3bef33019347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.260757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.261421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.261706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.262021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.274621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e1249147-49a1-4d60-8bad-3bef33019347 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:26.275851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e1249147-49a1-4d60-8bad-3bef33019347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:26.291522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:26.297176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:26.298100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:26.298880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:26.299479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 64/120] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:26.306030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.393803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 57/121] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:26.395201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0bd3-fc98-4bf2-b776-bbe27fe83e26 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.395499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0bd3-fc98-4bf2-b776-bbe27fe83e26 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.395851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a0bd3-fc98-4bf2-b776-bbe27fe83e26 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.397580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 58/122] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:26.402880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.403178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.403470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.441479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:26.442716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:26.464675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854032-6e51-436c-b94c-b62283ce64cc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.481566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.503697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.504381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.504663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.504985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.505720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:26.506033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:26.507445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:26.517187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 65/123] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:26.518043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.545386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 59/124] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:26.552116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.556765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.647212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6acdb-0436-4026-aaaa-258bfa2e88f9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.692433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.693525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.693811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.694092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.707140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:26.708162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472cb3-6f3c-484c-81fe-ed20279c8d34 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:26.712358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:26.713212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:26.714004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 66/125] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:26.715485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.750151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.750841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.751130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.751408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.752623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:26.754096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:26.755878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 60/126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:26.760643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.782684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.814805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:26.826622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9402-d635-4651-b2c4-a66ae6c61b80 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.872166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046655-e3d1-4305-b38d-3f54183896c0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:26.893574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.894264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.894551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.894829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.911910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:26.917753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:26.919381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:26.922060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 67/127] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:26.923624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:26.923624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:26.923624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:26.923624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:26.924261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:26.924645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:26.925693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:26.929295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:26.935244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 61/128] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:26.941486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.025297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.046854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e637204-cf1a-494b-b746-f2920bdc4ab5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.082720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.083351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.083665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.083998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.084783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:27.085098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.086490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.103817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.106069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.142197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f94c8-1e2d-4ca6-95e8-19e8b99957fa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.233593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d173619-ed1d-48ca-88cc-37a7628fa15f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.249016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.249675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.249965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.250249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.256471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.257969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.259824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 68/130] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:26 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.260441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.278240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.278808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.279094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.279374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.280611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.282085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.284007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 63/131] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:27 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.284764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.302232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.328238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.394345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7730c27-cc8e-4fa7-bc91-88828cc66767 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.440115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47134adf-c4fa-456e-af17-9685373b861c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.445773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.446809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.447331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.451943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/324f5132b96b4ed6a03451226e91b982/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.454357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, user_id=324f5132b96b4ed6a03451226e91b982, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.460174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.476719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.477429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.477780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.478070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.479376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.481264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 64/132] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:27 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/324f5132b96b4ed6a03451226e91b982/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:27.481558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.482697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.483357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 69/133] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:27 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.492892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.563417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.627932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf2fa-fb87-4c27-997f-bf9a53361161 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.676233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.700737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e839a-d2f6-44b7-a802-6775030430c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.701622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.702485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.702915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.703336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.706252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.707921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.715359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 65/134] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:27 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.721047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.792785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.793205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.793492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.793773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] PATH_INFO: `/v3/projects/58984c118bd645d3b118babe7129471a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.795011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] RBAC: Authorizing `identity:get_project(project_id=58984c118bd645d3b118babe7129471a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.796585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.798861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 70/135] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:27 2022] GET /identity/v3/projects/58984c118bd645d3b118babe7129471a => generated 312 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:27.806582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:27.831519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29612a67-3c7e-4a8c-aa54-2cd54d49fef6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:27.866793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:27.867826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:27.868260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:27.868688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/c69133dfb93e42eea2175539531bcb21/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:27.871733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, user_id=c69133dfb93e42eea2175539531bcb21, role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:27.873376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2e9f-dcb9-435b-b79a-d819113721ac None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:27.882547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:27.889383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 66/136] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:27 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/c69133dfb93e42eea2175539531bcb21/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:45:27.974920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e579df-2f00-494d-b00f-3265311542e8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:28.013688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47464ece-8198-4a15-a407-646257264c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:28.014556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464ece-8198-4a15-a407-646257264c11 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.014969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464ece-8198-4a15-a407-646257264c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.015354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47464ece-8198-4a15-a407-646257264c11 None admin] PATH_INFO: `/v3/projects/58984c118bd645d3b118babe7129471a/users/c69133dfb93e42eea2175539531bcb21/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.017811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464ece-8198-4a15-a407-646257264c11 None admin] RBAC: Authorizing `identity:create_grant(project_id=58984c118bd645d3b118babe7129471a, user_id=c69133dfb93e42eea2175539531bcb21, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:28.019425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47464ece-8198-4a15-a407-646257264c11 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:28.037166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 71/137] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:27 2022] PUT /identity/v3/projects/58984c118bd645d3b118babe7129471a/users/c69133dfb93e42eea2175539531bcb21/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:28.159089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e863b9-9dd6-4c69-9f96-60c18e55260c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.159456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e863b9-9dd6-4c69-9f96-60c18e55260c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.159861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e863b9-9dd6-4c69-9f96-60c18e55260c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.161930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 67/138] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:28.169687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.170129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.170580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.189865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:28.191230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:28.204593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:28.267997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 72/139] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:28.308220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e863b9-9dd6-4c69-9f96-60c18e55260c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:28.437381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e863b9-9dd6-4c69-9f96-60c18e55260c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:28.482018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:28.482682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.482972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.483255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.484489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:28.485967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad47018-45e9-42e6-b77e-7fb3642d6f9c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:28.487808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 68/140] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:28.493257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:28.637512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9186a-a4d9-44d8-8956-840ccfe94f22 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:28.685560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:28.686369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.686749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.687122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.688009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:28.689512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c5444-7585-4118-a659-8fab6e3bc6ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:28.716032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 73/141] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:28 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:28.860743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723c55-db6a-456d-b719-df322787d679 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.861039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723c55-db6a-456d-b719-df322787d679 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.861328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20723c55-db6a-456d-b719-df322787d679 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.862737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 69/142] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:28.868763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:28.869197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:28.869576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:28.877612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:28.895133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:28.896482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:28.994190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 74/143] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:29.030394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20723c55-db6a-456d-b719-df322787d679 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.119629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:29.165371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20723c55-db6a-456d-b719-df322787d679 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:29.203182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:29.203883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.204175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.204467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.215818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-20ee532f-5a45-46b0-bd3a-4c0056fd8bfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:29.225524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:29.226517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:29.227478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 70/144] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:29.236962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.294577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d002d-9c73-425b-9f83-62a1dda09b06 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.294902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d002d-9c73-425b-9f83-62a1dda09b06 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.295093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d002d-9c73-425b-9f83-62a1dda09b06 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.296450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 71/145] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:29.305122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.305410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.305692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.347797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:29.349252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:29.359266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9069fd-5495-428f-98e0-ba9a167971e3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:29.413040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:29.423344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:29.423999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.424286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.424564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.425295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:29.425603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:29.427014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:29.440562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 75/146] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:29.446081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.488186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 72/147] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:29.574681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.587781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e38fc-d67c-4a28-b1a5-81081785febb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:29.631457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:29.632160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.632442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.632717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] PATH_INFO: `/v3/users/859664c5f4044def97048c9ef4f4e82e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.634015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] RBAC: Authorizing `identity:get_user(user_id=859664c5f4044def97048c9ef4f4e82e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:29.635514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:29.638109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 76/148] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/users/859664c5f4044def97048c9ef4f4e82e => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:29.643499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.680492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:29.712861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:29.769934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef86f78-3e29-49ca-a338-d3c1d9b7e41e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:29.792051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720ab4-4a33-42b3-9687-5f5022ddeafb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:29.836019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:29.836596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.836874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.837153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.858253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:29.858956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:29.859236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:29.859506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:29.861062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:29.864047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:29.865515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:29.867193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 77/149] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:29.869865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:29.870720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:29.871609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 73/150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:29.876848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:29.879889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:30.054833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e949fe-fcc2-4502-b7d1-a8c1242d8790 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:30.067585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ea0ad-0e39-4880-9dce-4df7a395dea8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:30.095944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:30.102640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:30.106094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:30.107025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:30.107457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:30.111252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/859664c5f4044def97048c9ef4f4e82e/roles/7b09ac164cd440d28db6819fea31d58f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:30.114327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, user_id=859664c5f4044def97048c9ef4f4e82e, role_id=7b09ac164cd440d28db6819fea31d58f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:30.118606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:30.138122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 78/151] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:29 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/users/859664c5f4044def97048c9ef4f4e82e/roles/7b09ac164cd440d28db6819fea31d58f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:30.139562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:30.140337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:30.140695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:30.141048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:30.141861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:30.142237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:30.144853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:30.160746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 74/152] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:30.166682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:30.294086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346dcf1-7110-428e-9ef6-ab03811ba604 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:30.336311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:30.337360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:30.337821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:30.338268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:30.340311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:30.342010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:30.344022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 79/153] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:30 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:30.349976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:30.476476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5edb51-2a50-4a20-acb9-a77fa4ce5875 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:30.519965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:30.520921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:30.521381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:30.521848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:30.583786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:30.611294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:30.612742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:30.734890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 75/154] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:30.740969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:30.856528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:30.898922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947b44-7301-4a8c-b998-8c818835037d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:30.941407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:30.942059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:30.942335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:30.942607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:30.943819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:30.945288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fe7e4-2abd-4540-89bc-3f0012c31526 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:30.946975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 80/155] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:30 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:30.953038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:31.075430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:31.105813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96501-b75f-4105-934a-d9743c7021c0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:31.149067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:31.149622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.149910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.150196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.151028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:31.151345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:31.152890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510ca11-5d80-4960-b3eb-5c9ae013ced2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:31.159624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 76/156] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:30 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:31.177838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0516b9-7068-4b7a-b8e4-1b417e0f7fd7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.178164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0516b9-7068-4b7a-b8e4-1b417e0f7fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.178494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0516b9-7068-4b7a-b8e4-1b417e0f7fd7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.180360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 81/157] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:31.189872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf8d-74b6-43c1-b22a-3144216a1215 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.190168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf8d-74b6-43c1-b22a-3144216a1215 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.190443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf8d-74b6-43c1-b22a-3144216a1215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.216780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-749cdf8d-74b6-43c1-b22a-3144216a1215 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:31.218002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-749cdf8d-74b6-43c1-b22a-3144216a1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:31.302061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 77/158] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:31.344105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0516b9-7068-4b7a-b8e4-1b417e0f7fd7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:31.363186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53c84-fc31-4d34-ae53-9217ba4a75b0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.364266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53c84-fc31-4d34-ae53-9217ba4a75b0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.364753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53c84-fc31-4d34-ae53-9217ba4a75b0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.366457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 78/159] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:31.372251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c202-5550-4107-8fef-02e3173b55b1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.372842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c202-5550-4107-8fef-02e3173b55b1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.373391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c202-5550-4107-8fef-02e3173b55b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.404627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4b47c202-5550-4107-8fef-02e3173b55b1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:31.406252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b47c202-5550-4107-8fef-02e3173b55b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:31.516885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0516b9-7068-4b7a-b8e4-1b417e0f7fd7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:31.554841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 79/160] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:31.556465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f570-8571-4a0d-acc0-4dca3fec0552 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.556760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f570-8571-4a0d-acc0-4dca3fec0552 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.557037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f570-8571-4a0d-acc0-4dca3fec0552 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.559014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 80/161] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:31.565113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.565404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.565675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.579266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:31.580049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:31.608749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:31.609306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:31.609970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.610071 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:31.610251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.610526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.644705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:31.649873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:31.650774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:31.651803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 82/162] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:31.655975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:31.729022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 81/163] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:31.730869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:31.900209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17c92-adc7-4061-b93a-d6d7c2a04de6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:31.902837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9eb8-1b1e-4314-a73f-cc872f99fac0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:31.950892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:31.951551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.951858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.952127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.952582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:31.959799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:31.960706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:31.961202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:31.961669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:31.962597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:31.963096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:31.965012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:31.967382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:31.975165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:31.976113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:31.976914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:31.982404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 83/164] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:31.982404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:31.985068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 82/165] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:31.986265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.077194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:32.157530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9c454-6b5d-4331-b269-36b17a5e7c0a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.185912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642e7a1-a326-4e41-a98c-952886cfc5ab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.197897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.199961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.200453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.200983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.201997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:32.203001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:32.204664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:32.215807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 83/166] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:32.221206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.285050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.285975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.286259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.286530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.289069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:32.316683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:32.321710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:32.322606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 84/167] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:32.323827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.357271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a4b2-c301-4c6d-b544-3ed6fd3d5cb7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.437589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.438671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.439148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.439436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.444920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:32.446571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:32.448595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 84/168] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:32.449067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.585105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a9943-1498-4ed6-995f-3f3cdb3b7311 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.620014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:32.620185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090cfc2-e512-448a-8cb8-e72b09fea7c9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.622827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.623643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.623958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.624238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.624974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:32.625288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:32.626713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:32.637532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:32.649890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 85/169] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:32.650735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.721091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.721670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.721952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.722231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] PATH_INFO: `/v3/users/324f5132b96b4ed6a03451226e91b982` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.724557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] RBAC: Authorizing `identity:get_user(user_id=324f5132b96b4ed6a03451226e91b982)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:32.726247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:32.728111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 85/170] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/users/324f5132b96b4ed6a03451226e91b982 => generated 247 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:32.729239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.886153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8518770-421e-4f08-b276-78f4c74baad2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:32.951197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:32.951866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:32.952136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:32.952412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] PATH_INFO: `/v3/users/c69133dfb93e42eea2175539531bcb21` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:32.954689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c69133dfb93e42eea2175539531bcb21)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:32.956174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:32.957784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 86/171] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/users/c69133dfb93e42eea2175539531bcb21 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:32.958638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:32.962727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151c150-ba16-4748-9954-0d813d59105b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.013805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.014962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.016685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.017917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.047566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.126222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.143540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.145681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9766-16da-4531-92dd-31c4a68fd8ee None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.155768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f91d27-3161-4c4b-bda9-81d65bdca6b4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.229527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.231590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.232268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.233815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.272919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 86/172] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:33.274491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb834d-cd7f-4936-8110-4238d8f49001 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.274993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb834d-cd7f-4936-8110-4238d8f49001 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.275509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb834d-cd7f-4936-8110-4238d8f49001 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.277017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 87/173] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:33.278893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb834d-cd7f-4936-8110-4238d8f49001 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:33.382173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.383672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.420044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.441333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb834d-cd7f-4936-8110-4238d8f49001 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.447032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.489012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.489638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.489914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.490183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.534805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 87/174] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:33.536249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:33.569117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.570582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f54e0c-6ae1-4fa2-8b7d-3d6ec6e81144 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.647032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695c004-24cc-4a64-8219-cef825dfff0f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.657442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.680476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 88/175] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:33.680476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be748f5-8251-4537-86ed-e985f0c630b1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.680476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be748f5-8251-4537-86ed-e985f0c630b1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.680476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be748f5-8251-4537-86ed-e985f0c630b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.687480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.688227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.688508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.688780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.689954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.691428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62246bc-759b-4fc4-b02c-953f7768dbc7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.693305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 88/176] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:33 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:33.694396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90873-54a8-460a-8854-0be96c9991e8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.694681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90873-54a8-460a-8854-0be96c9991e8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.694952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e90873-54a8-460a-8854-0be96c9991e8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.696342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 89/177] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:33.700979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e90873-54a8-460a-8854-0be96c9991e8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:33.701952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0be748f5-8251-4537-86ed-e985f0c630b1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:33.703212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0be748f5-8251-4537-86ed-e985f0c630b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:33.713731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.783867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 89/178] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:33.783867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd0da-03ba-4d50-88d3-82111d9c9b20 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.783867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd0da-03ba-4d50-88d3-82111d9c9b20 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.783867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dd0da-03ba-4d50-88d3-82111d9c9b20 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.784247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 90/179] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:33.789960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dd0da-03ba-4d50-88d3-82111d9c9b20 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:33.821855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e90873-54a8-460a-8854-0be96c9991e8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.858705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.859350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.859635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.859945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.861109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.862565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.868973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 90/180] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:33 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:33.869850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:33.899212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dd0da-03ba-4d50-88d3-82111d9c9b20 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:33.917014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.935248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:33.935910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.936188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.936457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] PATH_INFO: `/v3/projects/58984c118bd645d3b118babe7129471a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.937595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] RBAC: Authorizing `identity:get_project(project_id=58984c118bd645d3b118babe7129471a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:33.939040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94f16c-dd50-4cc0-85b0-0130ca948fec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:33.940699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 91/181] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:33 2022] GET /identity/v3/projects/58984c118bd645d3b118babe7129471a => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:33.941795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:33.942070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:33.942341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:33.950965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:33.959400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:33.960624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:33.973064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4b10f-243f-4fd9-a34e-3eb3bddd547a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.006264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.006879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.007159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.007434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.008257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:34.008564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.010024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31f649-3a05-471d-b215-404ef4cbf170 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.015702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 91/182] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:33 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.017006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.017294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.017566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.031916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 92/183] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:34.033264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.045689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:34.047263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:34.126271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 92/184] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:34.127453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.161794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef8915-4a17-4067-9ee5-e15eec80cfbe None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.179565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.202617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.203504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.203969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.204250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.215798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f67faf8e-74c6-4c7d-9feb-7882f26c56e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:34.220872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:34.221886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:34.222707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:34.223375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf13db-db88-435f-b906-5b13ec487a7a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.223620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf13db-db88-435f-b906-5b13ec487a7a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.228326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf13db-db88-435f-b906-5b13ec487a7a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.228470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.228551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 94/186] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:34.228551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf13db-db88-435f-b906-5b13ec487a7a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.265437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9906c73-bed6-4859-a75a-827eb0065479 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.300180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.300724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.301002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.301274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.302064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=324f5132b96b4ed6a03451226e91b982) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:34.302371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.303835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.309985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 93/187] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/role_assignments?user.id=324f5132b96b4ed6a03451226e91b982&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.310763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.351583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf13db-db88-435f-b906-5b13ec487a7a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.389578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.390334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.390622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.390876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.391687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=58984c118bd645d3b118babe7129471a, user.id=c69133dfb93e42eea2175539531bcb21) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:34.392049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.393663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.400823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 95/188] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/role_assignments?user.id=c69133dfb93e42eea2175539531bcb21&scope.project.id=58984c118bd645d3b118babe7129471a&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.401498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.447878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dceab-a300-4657-bef2-139f47b9e873 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.467550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.501803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.502570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.502857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.503151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.507861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.518592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:34.524960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:34.525943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:34.526757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 94/189] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:34.528073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.568187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951da1d-3e9c-491b-8d57-31d81d9f4e23 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.610143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.610791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.611143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.611333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.612520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.613972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa24daa-97ec-4758-b1e3-087dbb2cd7fc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.615804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 96/190] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.617484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afba58-94cc-4311-9849-69688d312030 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.617484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afba58-94cc-4311-9849-69688d312030 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.617484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afba58-94cc-4311-9849-69688d312030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.637774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b9afba58-94cc-4311-9849-69688d312030 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:34.638962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b9afba58-94cc-4311-9849-69688d312030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:34.653103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99df4d-538b-4717-8f83-62876ee1f631 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.688455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.689075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.689353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.689625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.690333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:34.690635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.692027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.700222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 95/191] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.701020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.717495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 97/192] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:34.727916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afba58-94cc-4311-9849-69688d312030 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.759604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.761625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:34.800882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55e127-cc57-4322-ab71-c703ca231b4c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.829632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afba58-94cc-4311-9849-69688d312030 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.834482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.835119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.835403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.835682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.836430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:34.836744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.838154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.846043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 96/193] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:34.850853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.864286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788850-2374-4feb-8bca-5289706979da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:34.864911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788850-2374-4feb-8bca-5289706979da None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:34.865194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788850-2374-4feb-8bca-5289706979da None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:34.865469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90788850-2374-4feb-8bca-5289706979da None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:34.866149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90788850-2374-4feb-8bca-5289706979da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:34.867603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90788850-2374-4feb-8bca-5289706979da None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:34.896739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 98/194] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:34 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:34.897549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788850-2374-4feb-8bca-5289706979da None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:34.963915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588404-fb84-4ce0-9e3f-c657bb64d501 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:34.987220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.002441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.003396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.003681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.003983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.013216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.023890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.024403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90788850-2374-4feb-8bca-5289706979da None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.025378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.028437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 97/195] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.029361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.067866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.068526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.068809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.069089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.081277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:35.086238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:35.087175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:35.088039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 99/196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:35.088711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.149282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c69663-609a-473a-8eff-84d7814a3836 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.194262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.195394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.195845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.196552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.197965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.200751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.202881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 98/197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.203949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.215657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f3ed-0644-47b0-b127-2f9722ab4fd1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.260774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.261703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.261977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.262361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.264032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.290465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.324033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ae4b-20f4-44eb-905f-f0a10942aa82 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.342301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.343739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.360882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.361564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.361853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.362132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.362859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:35.363169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.364743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.374087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 99/198] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.374918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.449650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 100/199] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:35.450332 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.485956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64679e34-11de-4e0c-8069-69da1dd82213 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.503378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.513106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.537864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.539511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.539977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.540422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.586025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a985-1d38-4cd6-b912-c7ac3afdf404 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.624416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.626024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.638903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.640046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.640500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.641256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] PATH_INFO: `/v3/users/859664c5f4044def97048c9ef4f4e82e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.643360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] RBAC: Authorizing `identity:get_user(user_id=859664c5f4044def97048c9ef4f4e82e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.645651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.647476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 101/200] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/users/859664c5f4044def97048c9ef4f4e82e => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.649067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.760135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d4f-aa9e-42c4-bb00-85a472aebebb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.769870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 100/201] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:35.770453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.783015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.788624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:35.804880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.805704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.806079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.806450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.807807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.810015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.811817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.812662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:35.893933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453928-4c95-45f2-b8c6-66bb39d63f50 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.932315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687e00-9772-489a-8ec6-c1ce9b546ca5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:35.939509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.940661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.940954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.941232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.971624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:35.972425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:35.972698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:35.972965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:35.974280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:35.975881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:35.977950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 103/203] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:35.978491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:36.022657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:36.024247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:36.035447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:36.050537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:36.100005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8dd05-2c61-439f-acff-63ac21e18818 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:36.128665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 101/204] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:36.129511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:36.138677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:36.139304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:36.139588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:36.139896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:36.140701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b93c95468de8465eb04a0aac671720b3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:36.141011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:36.142566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:36.148737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 104/205] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:35 2022] GET /identity/v3/role_assignments?user.id=b93c95468de8465eb04a0aac671720b3&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:36.149476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:36.244140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113f0e5-40b6-4260-80d4-2cb934d6994f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:36.254446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:36.268415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c5e89-aa7f-4824-8c89-26b23f293e2e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:36.282368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:36.283266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:36.283613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:36.284392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:36.285816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b93c95468de8465eb04a0aac671720b3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:36.286199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:36.288388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:36.290664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:36.296335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 102/206] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:36 2022] GET /identity/v3/role_assignments?user.id=b93c95468de8465eb04a0aac671720b3&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:36.312750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:36.313563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:36.313925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:36.314301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:36.315884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:36.317552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cac90-b91c-4512-9840-7b3de8651a1a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:36.320504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 105/207] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:36 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:36.326294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:36.467782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c458af-a821-4fc8-8e89-bcac99697129 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:36.504398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:36.505051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:36.505396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:36.505670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:36.506473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938, user.id=859664c5f4044def97048c9ef4f4e82e) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:36.506778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:36.508262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c05e8-b552-4077-acf2-28cfa7e31561 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:36.515626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 103/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:36 2022] GET /identity/v3/role_assignments?user.id=859664c5f4044def97048c9ef4f4e82e&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=7b09ac164cd440d28db6819fea31d58f => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:37.169685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80d9b4-94e4-4886-8015-e91fac138dea None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.170711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80d9b4-94e4-4886-8015-e91fac138dea None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.171196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80d9b4-94e4-4886-8015-e91fac138dea None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.172853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 106/209] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:37.178684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3c0e-5a9a-444e-a8eb-675c337b64d2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.179531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3c0e-5a9a-444e-a8eb-675c337b64d2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.180039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b3c0e-5a9a-444e-a8eb-675c337b64d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.199108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-247b3c0e-5a9a-444e-a8eb-675c337b64d2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:37.200602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-247b3c0e-5a9a-444e-a8eb-675c337b64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:37.234396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:37.273855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 104/210] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:37.297498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80d9b4-94e4-4886-8015-e91fac138dea None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.309619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6d90-1fae-4f7d-922f-ca56af3c0944 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.309911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6d90-1fae-4f7d-922f-ca56af3c0944 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.310183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa6d90-1fae-4f7d-922f-ca56af3c0944 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.311777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 105/211] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:37.317303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.317670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.317947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.336128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:37.337300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:37.411830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 106/212] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:37.413385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80d9b4-94e4-4886-8015-e91fac138dea None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.429849 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.451339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.452331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.452814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.453373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.468194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:37.474352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:37.475271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:37.476106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:37.483575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 107/213] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:37.485010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.532232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:37.538002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97461-91bd-44b0-9221-2c20eedc22a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.539867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:37.574642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.575294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.575572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.575907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.577116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:37.578694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:37.585042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 107/214] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:37.585918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.597668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dac2b-ac86-4972-8e0d-3cffa7eb1cdf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.632842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.633808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.634287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.634773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.635726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:37.636822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:37.638431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:37.648118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 108/215] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:37.654489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.691551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce8101-b651-4c70-92aa-4709fe69a771 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.726509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.726895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.727176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.727446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.728257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:37.729703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:37.754230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 108/216] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:37 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:37.765187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe852d6c-bc86-4f4b-bbc6-1af7267c1015 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.789301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:37.805254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.806406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.806941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.807418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] PATH_INFO: `/v3/users/14d10331a72e430e8756df941f02ced7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:37.824292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] RBAC: Authorizing `identity:get_user(user_id=14d10331a72e430e8756df941f02ced7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:37.826171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:37.832985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 109/217] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:37 2022] GET /identity/v3/users/14d10331a72e430e8756df941f02ced7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:37.834928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:37.865300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:37.955225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a8db-5e6e-4b7e-8891-4b7365aafd6c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:37.991544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:37.992856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:37.993344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:37.993816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.068675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:38.070519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:38.092559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:38.184939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 109/218] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:38.190265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:38.337465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf4c80-f246-42bd-be1c-be7f36753847 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:38.387791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:38.388883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.389360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.389896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.391288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:38.392962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba9932-054d-4fe9-b545-4b2d1422414d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:38.395130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 110/219] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:38 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:38.401376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:38.554039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c282-3711-4030-82df-0da8db3d7a46 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:38.575846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:38.581079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4082-2c91-4a3b-a9e5-3394cf31364b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.581647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4082-2c91-4a3b-a9e5-3394cf31364b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.582133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f4082-2c91-4a3b-a9e5-3394cf31364b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.584124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 111/220] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:38.590657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.591358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.591879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.607159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:38.607823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.608112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.608391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.609194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=14d10331a72e430e8756df941f02ced7) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:38.609510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:38.610973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838380d5-3e1f-44fa-a496-fc8ec2df9617 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:38.611799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:38.613170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:38.620335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 110/221] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:38 2022] GET /identity/v3/role_assignments?user.id=14d10331a72e430e8756df941f02ced7&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:38.624184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e06f8-c3eb-4b20-acbe-e85a149ab995 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.624476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e06f8-c3eb-4b20-acbe-e85a149ab995 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.624754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e06f8-c3eb-4b20-acbe-e85a149ab995 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.626278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 111/222] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:38.641143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:38.641454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:38.641705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:38.671811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:38.676318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:38.678964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:38.767152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 112/223] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:38.797865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 112/224] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:38.803832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:38.838538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:38.976541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4801acb-4d07-4247-97f4-96716338c528 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.016200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75219-6c11-43ee-bfab-c51ede4bda83 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.050095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.050751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.051032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.051310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.054739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:39.072453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:39.077487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:39.078374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:39.079168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 113/225] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:39.086256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.092264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.096551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.098935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.098935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.110441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:39.116170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:39.117111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:39.117931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:39.121611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 113/226] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:39.129012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.169733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:39.239392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47b93a-4f1f-4dd4-90e4-de85a72e547b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.275627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.276288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.276569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.276884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.277604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:39.277910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.279299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.292243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 114/227] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.294270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.333690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:39.386858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271f48e-6182-4a3f-8890-4d45d03ad63c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.418853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eabc1d-4fd5-4656-89a6-655e2344513a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.452769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.453414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.453695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.453968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.454702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:39.455009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.460520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.477919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.478567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.478846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.479118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.481046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.482503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.484140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 115/229] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.484898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.485220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 114/229] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.490229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.632113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:39.652882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011db1-c904-4cf5-9006-e8eb77174c78 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.696657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c915e-102a-4762-b796-e1f141de0e5e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.700315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:39.722561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.723223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.723511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.723806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.724993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.726467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.733624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 115/230] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.735246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.745911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.746503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.746782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.747059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.751329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.752815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.754729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 116/231] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.762678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.897115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6e0a3-610b-4aef-b86f-6988e2a0f51c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.936619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.937267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.937551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.937824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:39.939729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:39.941224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:39.946023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 117/232] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:39 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:39.952673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:39.959613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb60c8-8067-41ca-bba0-504524ebe4cf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:39.998436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:39.999039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:39.999323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:39.999658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b93c95468de8465eb04a0aac671720b3/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.002142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, user_id=b93c95468de8465eb04a0aac671720b3, role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:40.003734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d785c-5cda-49fa-8147-663334ea04e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:40.020614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 116/233] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:39 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b93c95468de8465eb04a0aac671720b3/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:45:40.028946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:40.142486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725c803-46b0-410a-96b3-55269717ec06 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:40.190544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:40.191233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.191512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.191805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b93c95468de8465eb04a0aac671720b3/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.193860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, user_id=b93c95468de8465eb04a0aac671720b3, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:40.195333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8b15-2bf6-4ac5-9270-999a17b151e9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:40.218858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 118/234] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:39 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b93c95468de8465eb04a0aac671720b3/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:40.390701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c106f-38e8-4f5b-b593-70c45e581534 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.391189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c106f-38e8-4f5b-b593-70c45e581534 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.391264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c106f-38e8-4f5b-b593-70c45e581534 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.392905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 117/235] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:40.398835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.399674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.400183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.420654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:40.422293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfca9d5-ee8f-4a10-bbfd-d1a95093bbdb None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.422532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:40.423008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfca9d5-ee8f-4a10-bbfd-d1a95093bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.423506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfca9d5-ee8f-4a10-bbfd-d1a95093bbdb None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.425073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 118/236] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:40.437393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.438003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.438484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.464784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:40.465693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:40.478772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:40.543782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 119/237] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:40.558612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 119/238] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:40.595157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:40.597088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:40.652126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:40.721314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e436-4432-4b86-a558-f066875b6a46 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:40.769644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:40.770310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.770590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.770926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.772168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:40.773655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:40.775262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 120/239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:40.781826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:40.815050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:40.818977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ae22-b71b-416b-88d9-4a71c91d6ba6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:40.882345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:40.882991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.883269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.883549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.907615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:40.922400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:40.923359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:40.924863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 120/240] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:40.926845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988610ae-1973-4db7-803c-dccb93fa177a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:40.929481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:40.974354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:40.975352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:40.975862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:40.976378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:40.977353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:40.979108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:41.021161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 121/241] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:40 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:41.032562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.044713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35ff9b-f3cf-4ae9-9b34-3a25e574d787 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:41.087485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:41.088152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.088431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.088703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.090009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:41.090312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:41.091727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54111019-6300-4a17-aa11-f7f072814ba7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:41.102444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 121/242] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:41.107831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.122883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65d4b-d454-418d-9df9-d0a711d7bbce None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.123191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65d4b-d454-418d-9df9-d0a711d7bbce None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.123440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd65d4b-d454-418d-9df9-d0a711d7bbce None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.125047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 122/243] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:41.137936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.138267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.138477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.178463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:41.179688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:41.207534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.247093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92ae44-f4e5-404d-be99-e98098902460 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:41.291940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:41.292647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.292990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.293201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] PATH_INFO: `/v3/users/b087bf6571a246068a7d87840f44df28` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.309231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] RBAC: Authorizing `identity:get_user(user_id=b087bf6571a246068a7d87840f44df28)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:41.311121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:41.316002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 122/244] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/users/b087bf6571a246068a7d87840f44df28 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:41.321401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.324384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 123/245] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:41.350505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.438268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bc425-e43b-41a1-a3d4-42dbf2a0fcb9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:41.459884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.472287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.483277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30d76b-5370-49e7-8342-4e9c0d1eadd0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:41.486707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:41.487513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.487999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.488420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.524971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:41.525633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.525915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.526190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.537721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:41.543010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:41.544201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:41.545291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 124/246] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:41.558252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.590375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:41.591902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:41.721927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c57140-5bbd-417e-91ea-5383d0128704 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:41.779086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 123/247] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:41.785389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.799527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:41.800304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:41.800587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:41.802531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:41.803264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:41.803577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:41.805292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:41.819286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 125/248] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:41.825560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:41.831777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.840788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:41.975956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82029c11-9245-439b-8068-f1a9c2db7eb5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:42.008480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1109b5-1722-44d9-926e-0ad5f8229e1e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:42.041452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:42.042194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.042490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.042773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.044920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:42.046391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:42.048530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 124/249] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:42.056011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:42.077125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:42.077838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.078126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.078404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] PATH_INFO: `/v3/users/14d10331a72e430e8756df941f02ced7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.079611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] RBAC: Authorizing `identity:get_user(user_id=14d10331a72e430e8756df941f02ced7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:42.081099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:42.082928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 126/250] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:41 2022] GET /identity/v3/users/14d10331a72e430e8756df941f02ced7 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:42.088900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:42.247383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:42.248041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:42.266699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69cec-2d02-4165-bd50-241ed61ece66 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:42.317724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65b19c-1fde-4c3a-be68-981a61a8f5ee None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:42.356723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:42.357366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.357655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.357933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.358734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b087bf6571a246068a7d87840f44df28) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:42.359047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:42.360530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:42.375015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 125/251] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:42 2022] GET /identity/v3/role_assignments?user.id=b087bf6571a246068a7d87840f44df28&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=7b09ac164cd440d28db6819fea31d58f => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:42.381698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:42.382387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.382674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.382954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.388668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:42.390167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d3856-8e44-4a20-99ea-13d4ac647e04 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:42.392275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 127/252] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:42 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:42.398102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:42.571375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061ad66-6b2f-4079-aec0-7d44632d0844 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:42.619320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:42.620088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.620997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.621282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/14d10331a72e430e8756df941f02ced7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.629544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, user_id=14d10331a72e430e8756df941f02ced7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:42.631054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630f67-2cfb-4be4-a622-cd32af50d279 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:42.656050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 126/253] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:42 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/14d10331a72e430e8756df941f02ced7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:42.786209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6746e-4531-41b5-81e2-a73a58ae6ef0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.786731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6746e-4531-41b5-81e2-a73a58ae6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.786731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6746e-4531-41b5-81e2-a73a58ae6ef0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.788366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 128/254] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:42.805849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.806150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.806419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.833058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:42.834196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:42.850891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:42.902025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daadd5-62b0-4087-b5bb-3b03edd36851 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.902333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daadd5-62b0-4087-b5bb-3b03edd36851 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.902594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daadd5-62b0-4087-b5bb-3b03edd36851 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.904132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 129/255] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:42.911546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:42.912095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:42.912716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:42.932365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 127/256] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:42.945795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:42.947001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:42.955832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.025860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 130/257] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:43.061615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.158517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bbd3f-0677-4ca2-899a-0568cdff8775 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:43.168096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:43.237570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42db24-800b-49ed-8467-9fe285f90aad None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:43.247689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:43.248373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:43.248651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:43.248922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:43.266798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:43.272893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:43.273784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:43.274593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:43.292758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 128/258] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:43.299850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.320993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:43.321649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:43.321840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:43.321938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:43.322182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:43.353146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:43.360047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:43.360945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:43.361751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:43.362867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 131/259] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:43.374842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.535139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fd0c-6c7c-4ae7-a79c-7a3e0c8c8c3e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:43.570121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cac3cd-0cab-4756-a076-2e52f9bced23 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:43.618293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:43.618978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:43.619187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:43.619458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:43.620241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:43.620539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:43.621937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:43.628112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:43.634721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 129/260] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:43.644035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:43.644681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:43.644870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.644968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:43.645226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:43.645966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:43.646276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:43.650163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:43.676834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 132/261] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:43.688281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.760254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:43.808631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed688a-9ffd-4ab0-bc93-a5b7ee44a7e1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:43.872082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:43.873055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:43.873475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:43.873891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:43.876003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:43.877619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:43.882908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 130/262] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:43.886901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:43.938868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd014-e77f-40dc-89bc-651e85f1a774 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.009327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.010222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.010747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.011165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] PATH_INFO: `/v3/users/b93c95468de8465eb04a0aac671720b3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.016594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] RBAC: Authorizing `identity:get_user(user_id=b93c95468de8465eb04a0aac671720b3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.018628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.020797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 133/263] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/users/b93c95468de8465eb04a0aac671720b3 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:44.029006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:44.104000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ce196-34a3-4b25-b3bf-5896b6eb7c36 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.148105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.173886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.174519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.174803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.175078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.191029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.220257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14789be-ab7a-4afe-81d0-180c9bc7dfdc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.281496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.282049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.282332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.282607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.297802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.299311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe0e1b-e6d8-47f3-9252-b13dd27ffa92 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.413518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.415134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da92c53-e4e6-4103-98ba-1b98b2191680 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.476979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 131/264] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:44.478288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8ae1-44e0-4d1d-bd20-f9f895db6d31 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.479618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8ae1-44e0-4d1d-bd20-f9f895db6d31 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.479868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8ae1-44e0-4d1d-bd20-f9f895db6d31 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.481293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 132/265] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:44.482674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f8ae1-44e0-4d1d-bd20-f9f895db6d31 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:44.530133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.568190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.598551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 134/266] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:45:44.599869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.600163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.600760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.623659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:44.624933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:44.642320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f8ae1-44e0-4d1d-bd20-f9f895db6d31 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.689333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.689988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.690272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.690548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.692244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.694058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cb7ab-116e-498c-b42c-976cd762cf6a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.699819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 133/267] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:44 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:44.701262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07993-113f-4b65-b11c-fd7c8336083b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.701599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07993-113f-4b65-b11c-fd7c8336083b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.701877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e07993-113f-4b65-b11c-fd7c8336083b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.703211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 134/268] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:44.703932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07993-113f-4b65-b11c-fd7c8336083b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:44.718523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 135/269] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:44.719421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:44.822630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.834034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a0d46-da50-4534-92b9-45396b803f1c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.841572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e07993-113f-4b65-b11c-fd7c8336083b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:44.851963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:44.879589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.880582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.881035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.881554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.881998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:44.882649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.882808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b93c95468de8465eb04a0aac671720b3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:44.882925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.883207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.883542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.884424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:44.885399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.886466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8cba1-97a9-49d9-918c-68bd9f516ef2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:44.888287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 135/270] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:44 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:44.889733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:44.889847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:44.890106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:44.899783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 136/271] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:44 2022] GET /identity/v3/role_assignments?user.id=b93c95468de8465eb04a0aac671720b3&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:44.899783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:44.930426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:44.932431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:45.085486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd353f-307f-4ec3-bdf5-1fca32ee705e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.098100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 136/272] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:45.099154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.132350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.133349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.133854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.134436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.146997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-14c208e9-df35-481a-bd2f-c92e446f2b19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:45.153534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:45.154485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:45.155300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:45.155953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 137/273] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:45.157396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee48a-6339-4a5b-8ab5-eb6c493651dd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.157396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee48a-6339-4a5b-8ab5-eb6c493651dd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.157396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee48a-6339-4a5b-8ab5-eb6c493651dd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.158564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 138/274] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:45.159120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccee48a-6339-4a5b-8ab5-eb6c493651dd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.183897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.221984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12768c-4b03-441e-b8c4-1d41a9ed9d1a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.233326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.263855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.264483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.264882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.265260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.266186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b93c95468de8465eb04a0aac671720b3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:45.266499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.268112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.274615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 137/275] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/role_assignments?user.id=b93c95468de8465eb04a0aac671720b3&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:45.275529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.296260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccee48a-6339-4a5b-8ab5-eb6c493651dd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.344954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.345804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.346087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.346366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.347854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.349760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013ba14-c1cc-499f-91e2-f56a759915ed None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.351493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 139/276] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:45.353360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.353658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.353941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.378530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:45.379804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:45.417736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7b734-8bca-40a9-9565-1cb7b4c3904a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.457131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.457857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.458136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.458411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.459123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:45.459427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.460922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6642b8e-a1d8-476a-ac75-e5a5e1e5fb0d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.461242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 140/277] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:45.462090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.477659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.485987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 138/278] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:45.485987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bb1d-c415-47f9-90d6-4d010d63102a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.485987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bb1d-c415-47f9-90d6-4d010d63102a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.485987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397bb1d-c415-47f9-90d6-4d010d63102a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.485987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 139/279] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:45.490012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397bb1d-c415-47f9-90d6-4d010d63102a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.525744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.573164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2be3f3-c7f3-45a6-a1a1-16e0f09fa915 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.596759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397bb1d-c415-47f9-90d6-4d010d63102a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.607194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.607853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.608137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.608410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.609089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.610547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.631521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 141/280] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:45:45 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:45.632030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.632678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.632942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.633079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.633274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] PATH_INFO: `/v3/users/8293358e32dc434fb76c8aea0b2f1d39` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.657395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] RBAC: Authorizing `identity:get_user(user_id=8293358e32dc434fb76c8aea0b2f1d39)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.659023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60c5d7-3ce0-48ed-9251-b2727062e98e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.666144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 140/281] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/users/8293358e32dc434fb76c8aea0b2f1d39 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:45.666144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.666144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.666144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.681913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:45.683701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:45.718036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.756300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 141/282] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:45.757165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.760341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad7f37-09c6-4773-a637-bd77f536ec09 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.779036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:45.795646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.796384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.796674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.796949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.809282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:45.814932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:45.816085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:45.816994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 142/283] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:45.817729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.874794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641000f7-1ac3-4e3e-ae10-252b563612ad None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.924049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:45.924684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:45.924959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:45.925242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:45.926094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, user.id=8293358e32dc434fb76c8aea0b2f1d39, scope.system=all) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:45.926606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:45.929713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:45.934568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 142/284] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/role_assignments?user.id=8293358e32dc434fb76c8aea0b2f1d39&scope.system=all&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:45.935444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:45.953293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb695ef-93ed-4140-87b0-6edb75dfada4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:45.996696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.008169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.008838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.009120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.009652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.027049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:46.034998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:46.036195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:46.036995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 143/285] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:46.044399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.067855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.090369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade48e4-184f-43fa-9f63-cc03346faecf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.137186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.137739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.138025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.138296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.139016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:46.139323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.140890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.149883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 143/286] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:46.156229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.177152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d225-77a6-43d9-96aa-26cf3e4ab0c9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.212579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.213230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.213500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.213842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.215085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:46.215389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.216833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.233987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 144/287] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:46.241792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.311483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.329916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab18e3d-6a2a-43ae-80a5-cc9c59991427 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.371670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332defb-9550-4477-a23f-2b8130c001d4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.414722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.415773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.417298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.417771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] PATH_INFO: `/v3/users/14d10331a72e430e8756df941f02ced7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.419989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] RBAC: Authorizing `identity:get_user(user_id=14d10331a72e430e8756df941f02ced7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.422096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.424813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 145/288] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:46 2022] GET /identity/v3/users/14d10331a72e430e8756df941f02ced7 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:46.430390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.435806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.436786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.437261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.437728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] PATH_INFO: `/v3/users/b087bf6571a246068a7d87840f44df28` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.440964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b087bf6571a246068a7d87840f44df28)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.443919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.446116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 144/289] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:46 2022] GET /identity/v3/users/b087bf6571a246068a7d87840f44df28 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:46.452546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.489691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.588851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b35ca-233c-4491-8678-0a8dd5c152c4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.635442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.637168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.637601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.638157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.644494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.646166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.650821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 145/290] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:46 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:46.654962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:46.657874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076e245-411a-47a6-ad60-4d056e577912 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.693462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.724552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.725231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.725507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.725780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.782774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:46.802794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc435e9-a099-431e-a9fb-fc6f8da65b4e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:46.841079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:46.841886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:46.842169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:46.842502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b087bf6571a246068a7d87840f44df28/roles/7b09ac164cd440d28db6819fea31d58f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:46.844668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, user_id=b087bf6571a246068a7d87840f44df28, role_id=7b09ac164cd440d28db6819fea31d58f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.846694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:46.867032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 146/291] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:45:46 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/users/b087bf6571a246068a7d87840f44df28/roles/7b09ac164cd440d28db6819fea31d58f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:46.889100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:46.890583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:47.006089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 146/292] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:47.013209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:47.143950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be899ac-babf-4b09-baf9-6aa2d2b0cb80 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:47.179731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:47.180745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:47.181305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:47.181786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:47.183334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:47.185101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9378a-45cf-4f05-85af-f2c6571991cf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:47.187287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 147/293] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:47 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:47.192924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:47.221003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:47.324388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404be4d-d49e-4908-8ba3-155c14bc5ea1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:47.373673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:47.374292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:47.374566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:47.374834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:47.375614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=14d10331a72e430e8756df941f02ced7) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:47.375948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:47.377379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad518-3608-46ad-a664-4d16f38656df None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:47.383802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 147/294] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:47 2022] GET /identity/v3/role_assignments?user.id=14d10331a72e430e8756df941f02ced7&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:47.988936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279197b9-b17c-4730-80f0-19cecdcdc683 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:47.989479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279197b9-b17c-4730-80f0-19cecdcdc683 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:47.989479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279197b9-b17c-4730-80f0-19cecdcdc683 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:47.991722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 148/295] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:47.998348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4153d3b-464b-4376-b1d7-b075459d09d7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:47.998641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4153d3b-464b-4376-b1d7-b075459d09d7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:47.998923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4153d3b-464b-4376-b1d7-b075459d09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.022031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4153d3b-464b-4376-b1d7-b075459d09d7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:48.023607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4153d3b-464b-4376-b1d7-b075459d09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:48.100464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 148/296] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:48.125641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279197b9-b17c-4730-80f0-19cecdcdc683 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.140810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.240990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279197b9-b17c-4730-80f0-19cecdcdc683 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.243949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaafee-8a80-4f8e-91a7-b3dd3edd2809 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.244412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaafee-8a80-4f8e-91a7-b3dd3edd2809 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.244490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaafee-8a80-4f8e-91a7-b3dd3edd2809 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.246144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 149/297] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:48.251089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.251377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.251657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.271068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:48.272339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:48.276656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.277326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.277607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.277880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.287602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.290887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:48.296759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:48.297694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:48.298789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 149/298] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:48.309051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.349166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 150/299] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:48.372180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.389896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.424735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948512a0-74f1-4186-bd91-1c4cd09ed333 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.464021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.464721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.468639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.468639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.468639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:48.468639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:48.468639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7838f1-4db6-48b0-a706-e81140aca4b7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:48.477181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 150/300] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:48.478452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac936-0dfc-4b81-a806-4bf0a4ba1e65 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.478746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac936-0dfc-4b81-a806-4bf0a4ba1e65 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.479023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ac936-0dfc-4b81-a806-4bf0a4ba1e65 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.481209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 151/301] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:48.482757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc957a-9838-490c-b3bf-5f8d6a1efd42 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.483736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ac936-0dfc-4b81-a806-4bf0a4ba1e65 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.519784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.520368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.520651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.520928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.522083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:48.523540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856454cd-ad05-451c-b075-65b9a98140ed None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:48.530311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 151/302] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:48.530311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.530311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.530311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.544788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:48.545968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:48.549136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.596954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ac936-0dfc-4b81-a806-4bf0a4ba1e65 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.618295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 152/303] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:48.619175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.639449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.644964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.646025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.646313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.646590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] PATH_INFO: `/v3/users/d3c64009cc5b4315b72b0138263cd85e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.662216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c64009cc5b4315b72b0138263cd85e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:48.663812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:48.665673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 152/304] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/users/d3c64009cc5b4315b72b0138263cd85e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:48.666277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.734830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428688c4-cf3a-4713-8cd0-48733a60f7cc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.765710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1b87-9758-49a9-afd1-e6d3656a38f6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.771066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.771624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.771929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.772200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] PATH_INFO: `/v3/groups` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.772856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:48.774419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:48.787435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.804146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 153/305] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Aug 4 20:45:48 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:45:48.805429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.816915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.817582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.818598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.818938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.838334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:48.844006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:48.844918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:48.845728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 153/306] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:48.857367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:48.943342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:48.946880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63fe5c-d3d0-476f-b29c-cfbbf0d5a90f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:48.990223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:48.991195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:48.991701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:48.992245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:48.993295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, user.id=d3c64009cc5b4315b72b0138263cd85e, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:48.993843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:48.995576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.002376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 154/307] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/role_assignments?user.id=d3c64009cc5b4315b72b0138263cd85e&scope.system=all&role.id=7b09ac164cd440d28db6819fea31d58f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:49.006559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd2c1-7f4a-47b3-bf9a-dddcefd57249 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.046764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.047314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.047591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.047890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.048625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:49.048927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:49.050488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.061466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 154/308] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:49.066792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.138463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:49.182156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5d034-68f8-43d8-a31b-ab99075b8023 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.218507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.219517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.220033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.220535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] PATH_INFO: `/v3/users/8293358e32dc434fb76c8aea0b2f1d39` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.221950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] RBAC: Authorizing `identity:get_user(user_id=8293358e32dc434fb76c8aea0b2f1d39)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:49.223621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04e572-86fd-4f76-aa72-af071d99b79c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.225791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 155/309] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:49 2022] GET /identity/v3/users/8293358e32dc434fb76c8aea0b2f1d39 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:49.234351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.245796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73885370-14d1-4123-8d20-edb5d28b81f0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.246296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73885370-14d1-4123-8d20-edb5d28b81f0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.246403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73885370-14d1-4123-8d20-edb5d28b81f0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.247697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 156/310] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:49.253452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.253693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.253971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.275782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:49.277028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:49.345846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d163f75-ae8e-4850-8b8c-abe6bfa9f0da None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.349072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 157/311] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:49.360165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:49.374824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.383701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.384623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.384911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.385241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] PATH_INFO: `/v3/system/users/8293358e32dc434fb76c8aea0b2f1d39/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.386914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8293358e32dc434fb76c8aea0b2f1d39, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:49.388428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.403891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 155/312] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Aug 4 20:45:49 2022] PUT /identity/v3/system/users/8293358e32dc434fb76c8aea0b2f1d39/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:49.453284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:49.502010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f31ef-3b2a-4412-974b-76dadd28c1d3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.540830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.541488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.542327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.542603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.554888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:49.560134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:49.561278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:49.562164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 158/313] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:49.567532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.682063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3c8b-e2f7-4973-9672-40cba4fbaa1f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.719193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.719920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.720209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.720545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.721264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:49.721576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:49.722984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.732194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 156/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:49.737662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.846603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cabc87-0b65-46ad-b192-5bdf933f9beb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:49.871253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:49.884247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:49.884893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:49.885177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:49.885995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] PATH_INFO: `/v3/users/b087bf6571a246068a7d87840f44df28` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:49.887185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] RBAC: Authorizing `identity:get_user(user_id=b087bf6571a246068a7d87840f44df28)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:49.888675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:49.894874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 159/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:49 2022] GET /identity/v3/users/b087bf6571a246068a7d87840f44df28 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:49.896613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:49.940597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:50.005204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77db1e7-574e-48cd-a42e-b987c0b38c9f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:50.040704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:50.042640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:50.043067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:50.043487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:50.125254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:50.126850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:50.172581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:50.235072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 157/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:50.240441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:50.343942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a187e-8aad-4612-b307-b6eb7984c0da None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:50.378968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:50.379613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:50.379990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:50.380249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:50.381744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:50.383200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acde7f-0d41-4dfb-93e6-453159a14491 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:50.389746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 160/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:50 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:50.391084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:50.503428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e1c9-2ddc-4239-b895-7e556b64ad50 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:50.538508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:50.539133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:50.539416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:50.539692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:50.540507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3, user.id=b087bf6571a246068a7d87840f44df28) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:50.540824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:50.542429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8d1a-479f-45b5-950c-56ec2688cead None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:50.548863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 158/318] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:45:50 2022] GET /identity/v3/role_assignments?user.id=b087bf6571a246068a7d87840f44df28&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=7b09ac164cd440d28db6819fea31d58f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:51.021431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391453e-5307-42bf-befc-6ec5ee4e7501 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.022122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391453e-5307-42bf-befc-6ec5ee4e7501 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.022657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391453e-5307-42bf-befc-6ec5ee4e7501 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.024517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 161/319] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:51.030758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.031045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.031326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.037909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.050875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:51.052091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:51.058510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c27-f179-4f99-ba92-544029413d6b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.058792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c27-f179-4f99-ba92-544029413d6b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.059063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3935c27-f179-4f99-ba92-544029413d6b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.060685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 162/320] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:51.065497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.065783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.066058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.084223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:51.085382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:51.124277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 159/321] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:51.141725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.147257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.157089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 163/322] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:51.178436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.253173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350586c-1dce-4b88-b839-fb847a7e67dc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.284106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.285600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0849b-abf1-4a2c-a289-547bd62eddb1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.293034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.293684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.293966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.294241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.295383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:51.296899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:51.298494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 160/323] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:51.304859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.324699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.325490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.325669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.325929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.336745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:51.341670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:51.342581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:51.343628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 164/324] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:51.348415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.398122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.418047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4383a-14ae-4779-9530-afdde6f55563 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.450285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d6641-020a-46cb-b935-362a53ac7ff5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.462506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.463164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.463483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.463779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] PATH_INFO: `/v3/groups` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.464906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:51.465920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:51.484766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 161/325] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Aug 4 20:45:51 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:45:51.490323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.490974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.491257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.491534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.492300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:51.492609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:51.494035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe76e7-49e1-4d01-91f1-1e3ce7332d75 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:51.504669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 165/326] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:51.510334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.518008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e4710-32fd-4b03-a9ca-2adaa546c3b2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.518321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e4710-32fd-4b03-a9ca-2adaa546c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.518576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e4710-32fd-4b03-a9ca-2adaa546c3b2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.521838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 166/327] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:45:51.525619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.525913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.526187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.546112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:51.547252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:51.581994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.626882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 167/328] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:51.629187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a6df-4386-4b87-824d-ca06e685c171 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.649727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.668713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.668907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.669132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.669422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] PATH_INFO: `/v3/users/d3c64009cc5b4315b72b0138263cd85e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.670571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] RBAC: Authorizing `identity:get_user(user_id=d3c64009cc5b4315b72b0138263cd85e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:51.672077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:51.673974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 162/329] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/users/d3c64009cc5b4315b72b0138263cd85e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:51.679432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.699929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.776852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614f99b-8554-400f-bc9e-43632212de21 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.800347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c46bbd-fc74-41c9-bea9-afc3034d37ca None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:51.818420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.819077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.819530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.819858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.833818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:51.839449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:51.841599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:51.842553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:51.843348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 168/330] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:51.848190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:51.849525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:51.849879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:51.850163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:51.850437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] PATH_INFO: `/v3/system/users/d3c64009cc5b4315b72b0138263cd85e/roles/7b09ac164cd440d28db6819fea31d58f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:51.853200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d3c64009cc5b4315b72b0138263cd85e, role_id=7b09ac164cd440d28db6819fea31d58f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:51.853921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:51.862714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 163/331] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Aug 4 20:45:51 2022] PUT /identity/v3/system/users/d3c64009cc5b4315b72b0138263cd85e/roles/7b09ac164cd440d28db6819fea31d58f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:45:51.968827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:51.972837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211d61d-ee7b-49e9-b3a0-e3f83afbc1be None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:52.016883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:52.017887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:52.018368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:52.018841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:52.019811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:52.020943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:52.022548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:52.033535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 169/332] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:52.039556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:52.152196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810d7fd-d779-4843-becc-1aba6912c882 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:52.193641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:52.194311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:52.194591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:52.194864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] PATH_INFO: `/v3/users/8293358e32dc434fb76c8aea0b2f1d39` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:52.196110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] RBAC: Authorizing `identity:get_user(user_id=8293358e32dc434fb76c8aea0b2f1d39)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:52.197566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6065481-7691-414f-8e82-eae3cd1933d6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:52.199567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 164/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:52 2022] GET /identity/v3/users/8293358e32dc434fb76c8aea0b2f1d39 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:52.205618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:52.343535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4786-994f-40a4-82ae-3ce661ca3d5c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:52.380645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:52.381265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:52.381540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:52.381819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:52.382614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] RBAC: Adding query filter params (role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, user.id=8293358e32dc434fb76c8aea0b2f1d39, scope.system=all) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:52.382930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:52.384407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c56a5-767d-4d36-878d-aa4475c8f88e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:52.402665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 170/334] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 4 20:45:52 2022] GET /identity/v3/role_assignments?user.id=8293358e32dc434fb76c8aea0b2f1d39&scope.system=all&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:53.914243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d93-790b-4661-b7de-1d618a1edcb9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:53.914744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d93-790b-4661-b7de-1d618a1edcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:53.914819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d93-790b-4661-b7de-1d618a1edcb9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:53.916902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 165/335] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:53.922456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:53.922901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:53.923071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:53.952821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:53.954051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:53.969352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:54.038779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 171/336] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:54.071461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7d93-790b-4661-b7de-1d618a1edcb9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:54.162835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:54.212880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7d93-790b-4661-b7de-1d618a1edcb9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:54.261494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:54.262143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.262427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.262702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.280497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:54.286356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:54.287284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:54.288123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 166/337] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:54.296875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:54.456206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2899a-4990-4af8-a49d-f888fa651ea8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:54.502367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:54.503006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.503292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.503572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.504333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:54.504643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:54.506029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2c90-2c46-4b96-a7c7-2e0f05fb85f5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:54.519609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 172/338] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:54.525537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:54.638602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb6-6547-46a5-82d1-4575f9d747d9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.638918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb6-6547-46a5-82d1-4575f9d747d9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.639161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb6-6547-46a5-82d1-4575f9d747d9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.640688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 173/339] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:54.645865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957073fa-4e78-40ca-9f1e-31bfdac785df None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.646391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957073fa-4e78-40ca-9f1e-31bfdac785df None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.646858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957073fa-4e78-40ca-9f1e-31bfdac785df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.674135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-957073fa-4e78-40ca-9f1e-31bfdac785df None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:54.675855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-957073fa-4e78-40ca-9f1e-31bfdac785df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:54.693026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:54.732629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160618-3169-42dc-aec0-05519154c00f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:54.781574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:54.807445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:54.808530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.808959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.809480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.815357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 174/340] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:54.816971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a179b1-d39d-4fbb-8c5f-4e2423bc0b4b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.823779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a179b1-d39d-4fbb-8c5f-4e2423bc0b4b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.824523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a179b1-d39d-4fbb-8c5f-4e2423bc0b4b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.825983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 175/341] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:54.827098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac302-f218-4364-aa57-4fef6610c277 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.827378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac302-f218-4364-aa57-4fef6610c277 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.827791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ac302-f218-4364-aa57-4fef6610c277 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.829246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 176/342] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:54.831567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44bc4b-fee4-4497-9b2b-d7c3281578a7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.832246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44bc4b-fee4-4497-9b2b-d7c3281578a7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.832718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44bc4b-fee4-4497-9b2b-d7c3281578a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.860728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9b44bc4b-fee4-4497-9b2b-d7c3281578a7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:54.862271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9b44bc4b-fee4-4497-9b2b-d7c3281578a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:54.909867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:54.911508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:54.940013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 177/343] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:45:54.941979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:54.942481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:54.942967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:54.961522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:54.963021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:55.026650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 167/344] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:55.027483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.037006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 178/345] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:55.038114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.046305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.061553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.150182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b3807-997c-46b6-8e91-f45cf423bd7f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.170754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc71a7-328b-465c-b921-a4d86ed22484 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.195257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.196284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.196824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.197523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.209378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:55.211696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.212585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.213011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.213464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:55.215783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:55.216695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:55.217537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:55.218147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 179/346] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:55.218794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.227826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:55.234056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:55.235162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 168/347] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:55.241619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.297859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.348611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1b86-2c47-4288-af28-0c671a90cd00 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.352134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.377500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9680-8161-478e-b2be-245e1abb6409 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.397402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.398062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.398347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.398646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.400151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:55.401634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:55.404137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 180/348] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:55.404947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.419265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.420344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.420826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.421311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.432654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:55.438584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:55.439468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:55.440302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:45:55.442643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 169/349] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:55.443626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.560870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dded88d-6074-41c5-9a81-cb0b20d82b0a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.576154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7829d-574d-40e6-b938-2b073990d8a9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.592703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.599432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.600183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.600540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.600976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.601918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:55.602443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:55.604710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:55.613857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 181/350] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:55.615132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.616357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.617314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.617429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.617794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.618662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:55.619016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:55.620729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:55.629944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 170/351] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:55.630617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.637834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.734378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca988d21-d0f4-4217-8274-88ded424c20e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.765684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c674d7-071e-4cb2-8339-a394d4fc2280 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.771628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.772474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.772905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.773343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.782740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:55.784824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:55.786826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 182/352] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:55.788822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.816342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.816342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.816342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.816342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.816877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:55.817121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:55.819142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:55.830538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 171/353] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:55.831645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:55.860522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.914153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:55.915876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7af3cd-2bef-4928-91f7-b918bca6ea59 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:55.959230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:55.961063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:55.961764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:55.962193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:55.963555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491861a3-b232-463b-8a95-24ff51927b23 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.007114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.008471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.008471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.008471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] PATH_INFO: `/v3/users/d3c64009cc5b4315b72b0138263cd85e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.009917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] RBAC: Authorizing `identity:get_user(user_id=d3c64009cc5b4315b72b0138263cd85e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.011391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bb1c0-6b78-4e34-8c10-2c82e384a0ae None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.013251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 172/354] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/users/d3c64009cc5b4315b72b0138263cd85e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:56.014406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03de8-e93d-4273-b61a-4398a0641229 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.014686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03de8-e93d-4273-b61a-4398a0641229 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.014962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc03de8-e93d-4273-b61a-4398a0641229 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.018322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 173/355] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:56.019080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc03de8-e93d-4273-b61a-4398a0641229 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.048558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.050048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.117843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.154518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc03de8-e93d-4273-b61a-4398a0641229 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.172453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 183/356] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:56.173418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.185744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.191484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.192257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.192904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.192904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.193648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:56.193966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.195408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bedab-1c04-4935-9771-d293e1dde20f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.203835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 174/357] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:56.205395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.205688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.205965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.228295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:56.230047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:56.292018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa588-3ccc-4635-9d96-4fb5a79627ac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.309010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 175/358] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:56.309890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.329911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.330546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.330828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.331101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.364240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.428616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.430250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a870a-da9a-4a43-a6b9-83e74787b4ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.445457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc768c-f95c-4729-b5d2-3c00e699f46e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.485363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.497934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.498903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.499311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.499669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.500567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] RBAC: Adding query filter params (role.id=7b09ac164cd440d28db6819fea31d58f, user.id=d3c64009cc5b4315b72b0138263cd85e, scope.system=all) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:56.501339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.502639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.517295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 176/359] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/role_assignments?user.id=d3c64009cc5b4315b72b0138263cd85e&scope.system=all&role.id=7b09ac164cd440d28db6819fea31d58f => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:56.518149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.551370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 184/360] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:56.557666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b3dc-e296-48bc-b624-beb705ed8e06 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.557973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b3dc-e296-48bc-b624-beb705ed8e06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.558225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991b3dc-e296-48bc-b624-beb705ed8e06 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.560211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 185/361] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:56.561019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991b3dc-e296-48bc-b624-beb705ed8e06 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.629995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.672161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6586-6588-4f39-a59f-5f1d8a60f966 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.682721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991b3dc-e296-48bc-b624-beb705ed8e06 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.722187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.722905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.723190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.723458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.724175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.724841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.725126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.725411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.726610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.728139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.730377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 177/362] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:56.731157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.735716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-977df5ed-6ce3-4cd1-ac4f-85c0aa6472fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:56.741119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:56.742061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:56.742929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 186/363] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:56.745285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.745585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.745861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.765620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:56.767067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:56.807707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.851713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 187/364] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:56.852824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.876893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a460-f117-4433-9233-421df108f5e3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:56.905393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:56.922249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:56.923789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:56.923903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:56.924111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:56.926900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:56.928676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:56.930277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 178/365] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:56.931810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:56.968486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe21704-e693-4e63-9549-34d20e4adc65 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.011363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.012347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.012809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.013257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.014756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.016452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.018756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 188/366] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.024551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.061826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deafeb-3638-4a65-9747-e1877b5fe701 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.083919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.113362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.113992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.114277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.114551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.115268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:57.115955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.117304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.130982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 179/367] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.131856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.156095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9a96-d10b-46af-8e69-71008f4ae7c5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.173078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.195662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.196456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.196740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.197015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.216131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:57.222951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:57.224124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:57.225029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 189/368] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:45:57.225827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.260078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c44bee-1b69-47df-aeb0-4a3d7f1f54f7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.300766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.301409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.301693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.301974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.303675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.305151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.306788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 180/369] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.307564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.351612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce55b6-a04b-4a92-a0b9-f202608271d1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.376173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.400201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.401397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.401741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.401973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.402895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=90fbb6a4ee2145faa2acb64980afa938) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:57.403243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.404907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.413810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 190/370] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.414731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.465165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.468886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda809c2-35fd-433d-9344-c46945408eed None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.515391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.516006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.516290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.516565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.535570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cf57-aa80-4dd5-a847-508f1addc7ab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.574326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.575043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.575480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.575798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.576898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:57.577207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.578686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.592403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 191/371] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.593305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.603030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.604795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.669501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.716231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:57.720365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bae9fd-17a4-46a8-99db-8354f69e2bea None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.728874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 181/372] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:57.729869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.774594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.775469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.776185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.777474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.778431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:57.778942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:57.780608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:57.788639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 192/373] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:57.796113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:57.921299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85f3d6-b3d7-44f5-b090-ba4e6c5c897a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:57.992888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:57.993555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:57.993837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:57.994111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:57.997101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3b11-5db5-44ab-bfbd-17b62833c849 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.021547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.038669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.039292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.039574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.039974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.041742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.043309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.048163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 193/374] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:58.051368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.081415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.082984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.090804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.181038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355b5c-4671-4173-b14a-c23d1876eda5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.220153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.220799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.221074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.221347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.222663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.224133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.232139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 194/375] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:58.234441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.237604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 182/376] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:45:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:45:58.252623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.342422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.421355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.424411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58537f-e594-4bea-831d-aed5bddca338 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.439869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf3075-8bfd-40e0-9794-be90de4a11d4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.472256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.472942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.473221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.473585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.474461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:58.475244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.476713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.482819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 195/377] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:58.499271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.500039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.500318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.500590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] PATH_INFO: `/v3/projects/e33293e6de544d599e97bfb77454f460` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.501772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] RBAC: Authorizing `identity:get_project(project_id=e33293e6de544d599e97bfb77454f460)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.503209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e5548-c1f7-4717-bcc1-a10606b140ec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.505284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 183/378] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/projects/e33293e6de544d599e97bfb77454f460 => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:45:58.511495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.526331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae7c5-8288-4465-a2eb-4b0ece7088f6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.526673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae7c5-8288-4465-a2eb-4b0ece7088f6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.526885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ae7c5-8288-4465-a2eb-4b0ece7088f6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.528701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 184/379] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:45:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:45:58.542020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.542449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.542729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.584962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:45:58.586208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:45:58.694858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc00124-5cbe-473b-b567-ed682744b885 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.734077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.734726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.735002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.735275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] PATH_INFO: `/v3/groups/d98bf2492cd34407bdebced83f9b580c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.737608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 185/380] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:45:58.741558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] RBAC: Authorizing `identity:get_group(group_id=d98bf2492cd34407bdebced83f9b580c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:58.743015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:58.745495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 196/381] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/groups/d98bf2492cd34407bdebced83f9b580c => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:58.751243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.768396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.802457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.840055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:58.882192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7a8f5-3d30-4d56-9848-b5efda6e4bdd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:58.924680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:58.925331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:58.925674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:58.925945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:58.939970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:45:58.945430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:45:58.946323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:45:58.947873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 197/382] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:45:58.952614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:58.968199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299660-60fe-4170-8f6a-a53d7cb18f0b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:59.047283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:59.047991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:59.048273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:59.048678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:59.049483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] RBAC: Adding query filter params (group.id=d98bf2492cd34407bdebced83f9b580c, role.id=c757366a629b447b93eff207471f3401, scope.project.id=e33293e6de544d599e97bfb77454f460) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:59.049791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:59.051302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:59.060057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 186/383] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/role_assignments?group.id=d98bf2492cd34407bdebced83f9b580c&scope.project.id=e33293e6de544d599e97bfb77454f460&role.id=c757366a629b447b93eff207471f3401 => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:59.136197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:59.164136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab2c2-610e-441f-9736-265c34286f8a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:59.236555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:59.237121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:59.237401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:59.237675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:59.238405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:45:59.238711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:59.240134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:59.250309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 198/384] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:59.255547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:59.383352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d88c7-03af-483f-9dc6-fc70769f856a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:59.401960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:45:59.431240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:59.431965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:59.432251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:59.432529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:59.433691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:59.435148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:59.437088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 187/385] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:45:59 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:59.442331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:59.563563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447b3f-8ddd-4b1d-98d5-7c1978185970 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:59.609657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:59.610303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:59.610585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:59.610862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:59.612068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:59.613517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27298-3cc4-4985-b3a6-bd3389d0a86c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:59.615550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 199/386] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:45:59 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:45:59.624124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:45:59.748227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c5e1e-149a-472a-a625-25ce4c778b76 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:45:59.785839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:45:59.786525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:45:59.786806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:45:59.787084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:45:59.789048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, group_id=ec2209779c5d486fb13bbb3514f85ac1, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:45:59.790502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aae2a5-a64b-4938-96d8-aa2f40c6815e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:45:59.808665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 188/387] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 4 20:45:59 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:00.010690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7955a9-9c39-4c5e-8a2a-ca3798078ced None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.011101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7955a9-9c39-4c5e-8a2a-ca3798078ced None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.011300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7955a9-9c39-4c5e-8a2a-ca3798078ced None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.012963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 200/388] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:00.018474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.018759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.019030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.043396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:00.044661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:00.089120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:00.128023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 189/389] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:00.149907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7955a9-9c39-4c5e-8a2a-ca3798078ced None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.179311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:00.290416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7955a9-9c39-4c5e-8a2a-ca3798078ced None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:00.329009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:00.329674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.329960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.330233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.345120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e138dac8-2bb1-4476-88cf-e65b9fd895d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:00.350083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:00.351023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:00.352003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 201/390] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:00.359004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.440352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165bbb-0775-4b6f-b57a-898080c8a71e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.440638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165bbb-0775-4b6f-b57a-898080c8a71e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.440913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165bbb-0775-4b6f-b57a-898080c8a71e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.442542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 202/391] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:00.448666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.448958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.449237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.484795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:00.486011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:00.511613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0e7ee-2cf2-4733-b031-7711821494b1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:00.568593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:00.569145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.569427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.569702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.570424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:00.570732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:00.580380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:00.590086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 190/392] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:00.594567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 203/393] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:00.595396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.653498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:00.661038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.673419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:00.778643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b64a1-0b78-43d0-8cac-a656e1d59127 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:00.802448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb60ba1-baaa-44e0-8178-c0b929bc172f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:00.823440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:00.824407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.824865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.825680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.837600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:00.844567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:00.845498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:00.846310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:00.848906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 204/394] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:00.856713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.917112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:00.917961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:00.918117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:00.918394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:00.924489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:00.926032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:00.927970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 191/395] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:00.933658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:00.934585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:00.976778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d585b-a3fd-464a-a23c-657a6aa6450d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.016957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.017823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.018281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.018697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.019568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:01.020202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.021734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.033170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 205/396] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:01.045255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.167601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a037791-7bca-464f-8011-25dc9ae42549 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.179304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.182720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3f5fd-988c-4e88-8e68-bb1c2961b84e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.213001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.221031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.221772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.222060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.222340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.222449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.223234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.223499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.223839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.224254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.224993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45faf7-66a8-4eb7-9a5d-43786e590405 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.225719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.226941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 192/397] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:00 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:01.227656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.228176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f77f8-cf4d-4afa-a54e-697b31a282fb None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.229003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f77f8-cf4d-4afa-a54e-697b31a282fb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.229285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f77f8-cf4d-4afa-a54e-697b31a282fb None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.230496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 193/398] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:01.230750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 206/399] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:01.235873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f77f8-cf4d-4afa-a54e-697b31a282fb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.236791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.352861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f77f8-cf4d-4afa-a54e-697b31a282fb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.373081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90afd-049c-4649-8ec3-e39d06c922e5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.390327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.391015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.391302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.391582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.393900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=90fbb6a4ee2145faa2acb64980afa938, group_id=ec2209779c5d486fb13bbb3514f85ac1, role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.395368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96c202-33bc-44d2-bce9-68efd9cc74c3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.411341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 194/400] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 4 20:46:01 2022] PUT /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:01.413117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.413235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.413508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.419320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.420319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.420773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.421196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.422943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.424817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.427290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 207/401] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:01.434761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.435385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:01.436680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:01.464575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.519994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 195/402] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:01.544667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.594909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.647017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba34c4-591f-4996-b6fc-a351f2b54348 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.658433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f64c1-38fe-4cb2-a561-c32eb587e9af None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.683476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.684103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.684386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.684663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.686673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, group_id=ec2209779c5d486fb13bbb3514f85ac1, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.688155 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17661d5-62f7-4c5c-99c0-f5712a5f6f84 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.698416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.699140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.699417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.699696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.705494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 208/403] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 4 20:46:01 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:01.706901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb899eb-bbba-49f4-ad3b-a004a675a2c6 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.707231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb899eb-bbba-49f4-ad3b-a004a675a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.707481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb899eb-bbba-49f4-ad3b-a004a675a2c6 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.709231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 209/404] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:01.713527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:01.717060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.717403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.717705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:01.718988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:01.721278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:01.723274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 196/405] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:01.726188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.738242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:01.739452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:01.748938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.817957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 210/406] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:01.854881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.894339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85211ef-3e6e-4e90-b23d-e7a368aaf941 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:01.928236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:01.934073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:01.934679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:01.935818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:01.935818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:01.935986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:01.936274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:01.937664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:01.952965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 197/407] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:01.961402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:01.987381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef8160-bd93-4e77-a70e-f28e03d4487b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.024220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.025403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.026007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.026494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.037935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:02.044315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:02.045257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:02.046065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:02.053318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 211/408] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:02.054797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.110699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:02.152119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c3eee-ebd4-4777-a6a1-590ceda7ce7f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.162708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0d630-f7ee-4aed-bd09-0d2f151ca579 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.180293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:02.201402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ec53d-8438-443a-823f-161062506231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.202516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ec53d-8438-443a-823f-161062506231 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.203007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ec53d-8438-443a-823f-161062506231 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.203484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ec53d-8438-443a-823f-161062506231 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.204444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ec53d-8438-443a-823f-161062506231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:02.204968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ec53d-8438-443a-823f-161062506231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.206560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ec53d-8438-443a-823f-161062506231 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.217651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 212/409] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:02.223830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ec53d-8438-443a-823f-161062506231 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.276488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.277155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.277438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.277715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.284699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.286232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.288194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 198/410] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:01 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:02.296742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.331727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ec53d-8438-443a-823f-161062506231 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.368831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.370525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.370804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.371116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] PATH_INFO: `/v3/groups/d98bf2492cd34407bdebced83f9b580c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.372314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] RBAC: Authorizing `identity:get_group(group_id=d98bf2492cd34407bdebced83f9b580c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.373863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.376044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 213/411] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:02 2022] GET /identity/v3/groups/d98bf2492cd34407bdebced83f9b580c => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:02.381327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.439620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:02.490088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f7e4-9174-42ef-a67b-dfdd685ef905 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.527285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.528068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.528465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.528645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] PATH_INFO: `/v3/projects/e33293e6de544d599e97bfb77454f460` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.529792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] RBAC: Authorizing `identity:get_project(project_id=e33293e6de544d599e97bfb77454f460)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.531243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa7b3-bb01-4b4b-8803-4f6f517957ae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.535833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 214/412] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:02 2022] GET /identity/v3/projects/e33293e6de544d599e97bfb77454f460 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:02.537341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad678ae-22c2-4f4f-a601-f6971ad979dc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.537867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad678ae-22c2-4f4f-a601-f6971ad979dc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.538543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad678ae-22c2-4f4f-a601-f6971ad979dc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.539950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 215/413] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:02.540524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad678ae-22c2-4f4f-a601-f6971ad979dc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.590650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713fe81-aaa8-4a2f-a74b-4a79392d5d21 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.638501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.639184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.639469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.639764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.640951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.642409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ccd7a-5836-481c-a068-81fab699a60e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.644468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 199/414] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:02 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:02.645594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.645885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.646424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.664278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:02.665580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:02.672881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad678ae-22c2-4f4f-a601-f6971ad979dc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.677758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:02.691512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:02.716303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:02.717473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:02.718012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:02.718586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] PATH_INFO: `/v3/projects/e33293e6de544d599e97bfb77454f460/groups/d98bf2492cd34407bdebced83f9b580c/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:02.720930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] RBAC: Authorizing `identity:create_grant(project_id=e33293e6de544d599e97bfb77454f460, group_id=d98bf2492cd34407bdebced83f9b580c, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:02.722819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:02.739452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 200/415] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:02.740387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.746738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 216/416] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 4 20:46:02 2022] PUT /identity/v3/projects/e33293e6de544d599e97bfb77454f460/groups/d98bf2492cd34407bdebced83f9b580c/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:02.803299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:02.954808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f79b-862e-48a2-b4e1-c7d4472d1cb6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.967546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040c9b-c57e-4b99-bee5-d5e17727783b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:02.999728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:03.000760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.001056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.001334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.004143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] RBAC: Authorizing `identity:create_grant(project_id=add6b4772bea4d72a2d5fa4943c8feb3, group_id=ec2209779c5d486fb13bbb3514f85ac1, role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:03.006058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:03.011859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:03.012909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.014415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.015114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.024915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 201/417] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 4 20:46:02 2022] PUT /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3/groups/ec2209779c5d486fb13bbb3514f85ac1/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:03.030857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:03.037102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:03.038073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:03.039588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 217/418] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:03.044670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:03.055799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:03.182692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772429-4045-4514-ba0c-f4310614b261 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:03.219400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:03.220068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.220350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.220626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.221350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:03.221661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:03.223046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:03.235469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 202/419] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:03.237714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:03.274805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:03.367641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78351de-3424-4faa-b86f-7d69598ef32d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:03.406189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:03.406821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.407104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.407381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.531907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:03.533309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b70e4-d253-47a2-b84f-13ece39b88d4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:03.567806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:03.678029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 218/420] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:03.684943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:03.832684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:03.886807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fabc5-cde5-49cb-9ce6-79b280824a4c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.887254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fabc5-cde5-49cb-9ce6-79b280824a4c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.887373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fabc5-cde5-49cb-9ce6-79b280824a4c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.889162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 219/421] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:03.893754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9523-d80c-44a2-95dc-6282978d1e85 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:03.894293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.894582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.894864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.931258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:03.932471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:03.932752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:03.933028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:03.934345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:03.935853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:03.937811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 203/422] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:03 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:03.944046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:03.944793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:03.946002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:04.080011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 220/423] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:04.101599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08781ab9-c5bd-40de-9c87-0ab3ab813f83 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.108400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.170999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.172067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.172582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.173054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.174566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:04.176258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7c4c0-4c85-46d6-a212-b5a7c23267f8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:04.178601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 204/424] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:03 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:04.180168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3027-870b-4520-a5d4-fdd3bb546cc8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.180794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3027-870b-4520-a5d4-fdd3bb546cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.181277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3027-870b-4520-a5d4-fdd3bb546cc8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.182767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 205/425] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:04.187678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3027-870b-4520-a5d4-fdd3bb546cc8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.192019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.206138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.315770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0774c77-9d26-46bd-8439-6d64244d6232 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.354303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3027-870b-4520-a5d4-fdd3bb546cc8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.366697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.366981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.367257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.379854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2f20de21-ff56-4cf5-b2ae-b54818ea6202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:04.385025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:04.385920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:04.387041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 221/426] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:04.388119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.388119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.388347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.397944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.398669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.399024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.399449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.400441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=90fbb6a4ee2145faa2acb64980afa938) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:04.400830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:04.402514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:04.406715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:04.407949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:04.409663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 206/427] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:04.410645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.565405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 222/428] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:04.565843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.597388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.614035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a44b67-df9d-4a3c-bc36-1ec5eac4782f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.659779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.660441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.660726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.661002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.661723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:04.662031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:04.663417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:04.674576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 207/429] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:04.678482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.683043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.741586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ecc32-ac61-47a4-9132-9bffd3fe4df1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.785785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.786609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.786986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.787358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.798543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:04.803707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:04.804930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 20:46:04.805950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:04.807777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 223/430] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:04.813646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:04.815554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ac99-b695-47a8-8b98-baab085382a1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.846470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.855631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.856601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.857065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.857533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.924112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ec70e-2d07-4c70-a456-60400986173e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:04.935495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:04.937376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:04.940003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:04.962139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:04.962937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:04.963306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:04.963652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:04.964528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:04.964904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:04.966344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:04.976522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 224/431] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:04.983252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.049698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 208/432] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:46:05.056589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.096807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8285d-30a6-4795-9603-f4b9611de5e0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.100109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.134025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.135325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.135676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.136070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.170756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc264a7-ca2f-4ff7-bbc8-f603927bdcf1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.185148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.210609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.212215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9e25-4425-4a13-8b2a-c08b24e0defd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.213350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.214010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.214295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.214622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] PATH_INFO: `/v3/projects/90fbb6a4ee2145faa2acb64980afa938` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.216045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] RBAC: Authorizing `identity:get_project(project_id=90fbb6a4ee2145faa2acb64980afa938)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.217501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.219479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 209/433] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/projects/90fbb6a4ee2145faa2acb64980afa938 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:05.229103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.324623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 225/434] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:05.326558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bfad-ec7d-4475-a769-edbc44edea14 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.326845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bfad-ec7d-4475-a769-edbc44edea14 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.327118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74bfad-ec7d-4475-a769-edbc44edea14 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.328529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 226/435] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:05.332625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74bfad-ec7d-4475-a769-edbc44edea14 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.352823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.359128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba26dc-470b-4da5-9fc6-91a197328269 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.396800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.397446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.397728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.398004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.399263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.401157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f92b9d-274c-4196-aa59-5ed3d4ac690d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.403006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 210/436] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:05.405108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.405392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.405676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.427065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:05.427284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.428358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:05.457179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74bfad-ec7d-4475-a769-edbc44edea14 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.496862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.497554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.497835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.498143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.499241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.500105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 211/437] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:05.500779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.512590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.518959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 227/438] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:05.519778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.609230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.616571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897b93a-3ead-4010-80d5-135b4d8cb475 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.632913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b024-6cb0-4dec-9803-a8383de6bc28 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.653951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.654578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.654862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.655137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.655966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=90fbb6a4ee2145faa2acb64980afa938) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:05.656282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.657731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.675776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 212/439] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=90fbb6a4ee2145faa2acb64980afa938&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:05.675776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.682408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.683324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.683707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.684128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.685567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.687346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.689375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 228/440] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:05.696152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.740213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.799204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e9a0d-9c6a-43a1-9e30-33b0b8d468da None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.826793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e2b98-d9f5-4e2e-abb7-ddff3798ca2f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:05.839322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.840060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.840341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.840623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.851347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-86d35321-d091-497c-b417-5083ebf88713 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:05.856710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:05.857629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:05.858544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:05.860439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 213/441] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:05.861769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059a54-4040-4e8f-bfc1-27e154666f93 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.862061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059a54-4040-4e8f-bfc1-27e154666f93 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.862340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059a54-4040-4e8f-bfc1-27e154666f93 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.867688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 214/442] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:05.868533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059a54-4040-4e8f-bfc1-27e154666f93 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:05.873670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:05.874674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.874674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.874889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.875617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=9ef2e5b4300a4890ba2e2f7d9411f97f, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:05.875974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:05.877426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7626f-ac7f-449c-bce5-fcec46984c37 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:05.884202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 229/443] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=9ef2e5b4300a4890ba2e2f7d9411f97f => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:05.885761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:05.886044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:05.886320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:05.895420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:05.906945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:05.908810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:05.998066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 230/444] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:06.004299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059a54-4040-4e8f-bfc1-27e154666f93 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.022420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.033236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.053837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.053837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.053837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.054379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.055132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:06.055441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.057477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.067302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 215/445] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:06.076488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.148657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf594d-b4c0-4eb1-9045-1df36107108b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.186798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.191694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.192913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.192913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.192913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.204913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:06.209854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:06.210843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:06.211681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 231/446] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:06.214176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179922-deec-4812-a3d7-41a668b6c831 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.216868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.256578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.257135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.257416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.257691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.297400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.332174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89996c3b-0dbc-41cf-9c00-494f06d3f5ac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.333077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.334557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.364689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.365286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.365572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.365850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.366565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:06.366874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.368270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.376511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 232/447] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.381966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.414342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.433518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 216/448] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:46:06.438991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e69a-e095-43b8-aba4-0eb64f5417c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.505923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.514388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.514943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.515225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.515502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.538066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b946a4d-cd1a-4b8e-84f3-e24b3a22d332 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.571430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.572620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.572925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.573207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] PATH_INFO: `/v3/projects/e33293e6de544d599e97bfb77454f460` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.574371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] RBAC: Authorizing `identity:get_project(project_id=e33293e6de544d599e97bfb77454f460)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.575862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.577517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 217/449] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/projects/e33293e6de544d599e97bfb77454f460 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.582100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.582886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.583476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.630880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.681116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42972b41-3cec-424c-9597-fb36e9a1754f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.682013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 233/450] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:46:06.687542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.714872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.715023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.715578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.715958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.716163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] PATH_INFO: `/v3/groups/d98bf2492cd34407bdebced83f9b580c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.717330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] RBAC: Authorizing `identity:get_group(group_id=d98bf2492cd34407bdebced83f9b580c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.718786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.720587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 218/451] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/groups/d98bf2492cd34407bdebced83f9b580c => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.726004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.786446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a6821-63a5-40f0-ba5e-9ab7f23cfb6e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.820984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.821619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.821926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.822212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] PATH_INFO: `/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.823437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] RBAC: Authorizing `identity:get_project(project_id=add6b4772bea4d72a2d5fa4943c8feb3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.824266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0159-15c2-4351-8f4e-6e9f7b0f7a96 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.824897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.827128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 234/452] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/projects/add6b4772bea4d72a2d5fa4943c8feb3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.831944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:06.841854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.861154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.861777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.862066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.862350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.863137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] RBAC: Adding query filter params (group.id=d98bf2492cd34407bdebced83f9b580c, role.id=c757366a629b447b93eff207471f3401, scope.project.id=e33293e6de544d599e97bfb77454f460) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:06.863450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.864921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.871286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 219/453] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/role_assignments?group.id=d98bf2492cd34407bdebced83f9b580c&scope.project.id=e33293e6de544d599e97bfb77454f460&role.id=c757366a629b447b93eff207471f3401 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.931737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:06.938252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea837-78e6-4f78-ac0a-3facb709af5f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:06.972846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:06.973494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:06.973777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:06.974054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] PATH_INFO: `/v3/groups/ec2209779c5d486fb13bbb3514f85ac1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:06.975243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] RBAC: Authorizing `identity:get_group(group_id=ec2209779c5d486fb13bbb3514f85ac1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:06.976744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689ad15-b870-4e6b-8c1f-c76d8133b481 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:06.978982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 235/454] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/groups/ec2209779c5d486fb13bbb3514f85ac1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:06.985142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:07.091588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be19f18-e8a8-4324-82ca-6e6c8ef6edb4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:07.124844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:07.125455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:07.125739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:07.126017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:07.126804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] RBAC: Adding query filter params (group.id=ec2209779c5d486fb13bbb3514f85ac1, role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:07.127117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:07.128598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26517de-23e5-4436-ba7e-a499fc3140a3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:07.134752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 220/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 4 20:46:06 2022] GET /identity/v3/role_assignments?group.id=ec2209779c5d486fb13bbb3514f85ac1&scope.project.id=add6b4772bea4d72a2d5fa4943c8feb3&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:09.654226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665704-b39a-44df-9a27-a4c73f709f42 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:09.654782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665704-b39a-44df-9a27-a4c73f709f42 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:09.654782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51665704-b39a-44df-9a27-a4c73f709f42 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:09.656923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 236/456] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:09.667645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827d12-d54b-407c-9b32-ab150ad5a288 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:09.668160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827d12-d54b-407c-9b32-ab150ad5a288 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:09.668435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b827d12-d54b-407c-9b32-ab150ad5a288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:09.693075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8b827d12-d54b-407c-9b32-ab150ad5a288 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:09.694412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8b827d12-d54b-407c-9b32-ab150ad5a288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:09.750812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:09.802950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 221/457] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:09.831817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665704-b39a-44df-9a27-a4c73f709f42 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:09.961956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51665704-b39a-44df-9a27-a4c73f709f42 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:09.982652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d970c-82a7-48b2-ad17-58b914ef0e13 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:09.982994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d970c-82a7-48b2-ad17-58b914ef0e13 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:09.983207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d970c-82a7-48b2-ad17-58b914ef0e13 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:09.984573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 222/458] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:09.990008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4690-2630-42d0-987f-8107fb530ca2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:09.990496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4690-2630-42d0-987f-8107fb530ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:09.990993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4690-2630-42d0-987f-8107fb530ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.016149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.016905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f04c4690-2630-42d0-987f-8107fb530ca2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:10.017355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.017828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.018103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f04c4690-2630-42d0-987f-8107fb530ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:10.018503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.029697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.031199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8e37f508-2a4c-44b0-b88c-2750d8a04a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:10.047832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:10.048736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:10.049622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:10.049622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:10.049622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.049622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:10.049622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 237/459] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:10.050604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf661-c6a2-4148-a549-fbb5c5455e64 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.050888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf661-c6a2-4148-a549-fbb5c5455e64 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.056091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf661-c6a2-4148-a549-fbb5c5455e64 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.057656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 238/460] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:10.058388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf661-c6a2-4148-a549-fbb5c5455e64 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.081783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.105695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 223/461] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:10.107083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647390-0508-4aea-928e-17301abe9932 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.107368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647390-0508-4aea-928e-17301abe9932 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.107643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c647390-0508-4aea-928e-17301abe9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.127686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7c647390-0508-4aea-928e-17301abe9932 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:10.129123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7c647390-0508-4aea-928e-17301abe9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:10.198039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf661-c6a2-4148-a549-fbb5c5455e64 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.206408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 224/462] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:10.207406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647390-0508-4aea-928e-17301abe9932 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.242249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.243125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.243439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.244805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.245532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.246451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:10.246769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.248258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.265476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 239/463] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:10.266953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.326220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c647390-0508-4aea-928e-17301abe9932 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.368034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.368754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.369040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.369316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.374990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.385821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.388054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.404098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b95a3d-9403-4025-8970-9e4ea2d30845 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:10.409792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:10.410730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:10.412706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:10.412706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:10.412706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.412706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:10.415663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 225/464] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:10.416575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.445720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.446429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.447280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.447560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.458742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.460239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:10.475458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:10.477537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 240/465] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:10.480724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.512477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.526842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7d22b-da7b-4543-95d4-dfbee4267d75 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.563142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.564073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.564360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.564632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.565503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.567579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.586483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28490-d2ac-4ff2-a7f2-af0b81a94c2a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.599909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 226/466] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:10 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:10.600882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.638078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.654092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.655536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.656203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.656203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.656802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:10.657110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.659788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.693038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 241/467] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:10.697665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.822647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b88f91-fe16-4009-b69e-6e50570e4a5d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.827130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a654759-c043-4191-9da1-904e66b46b37 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:10.864556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.864876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:10.865182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.865466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.865576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.865741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.865853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.866036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.866432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.866727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:10.867033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:10.867926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.868981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986e63-e37b-428f-a23e-e4f6f7c6fd8d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:10.890280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 227/468] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:10.891569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9375-158f-4a81-a777-a3db84f3c64b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.891885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9375-158f-4a81-a777-a3db84f3c64b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.892168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc9375-158f-4a81-a777-a3db84f3c64b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.893392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 228/469] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:10.895890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 242/470] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:10 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:46:10.898613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:10.898870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:10.899168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:10.899451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:10.907329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:10.925960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:10.927531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:10.960466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:11.027774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 229/471] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:11.029420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162290a0-adda-4599-9d96-46e2c0dd78a0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.054481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:11.084067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.084612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.084894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.085167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.085860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:11.087434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:11.113661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 243/472] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:10 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:11.225250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41db7a9-121d-4488-b260-2c37025b8190 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.265122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.265791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.266073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.266347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.274136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:11.278942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:11.280482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b4fc15e9-bdf4-49f1-8306-df2320f607e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:11.297077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:11.297994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:11.298851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:11.298851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:11.298851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:11.298851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.298851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 230/473] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:11.305015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:11.404344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cd67-5301-4fe9-95c7-4ab7cd5dcf68 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.404714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cd67-5301-4fe9-95c7-4ab7cd5dcf68 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.405089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cd67-5301-4fe9-95c7-4ab7cd5dcf68 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.406805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 231/474] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:11.411591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:11.411928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.412218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.412493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.414708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b42d9-54c7-4546-abfa-982acd938ada None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.437304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:11.438512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:11.462858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.463491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.467767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.467767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.467767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:11.467767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:11.467767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:11.483338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 244/475] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:11.489660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:11.531944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 232/476] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:11.554566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:11.613101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561df2-7cc2-4f26-a24b-f9e345a3d44a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.657112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.657746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.657921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.658205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.659141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:11.660394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e0b8-07a1-4a2d-8906-61f6010cb8f5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.660622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:11.684174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:11.700831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.702076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.703328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.704646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.706067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:11.709547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:11.712096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 245/477] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:11 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:11.729139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.sql.core [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 20:46:11.729139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 20:46:11.729139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [parameters: {'id': '547975f4e2854382ae3b56bb78bb89e5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 20:46:11.729139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80218) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() Aug 04 20:46:11.748690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:46:11.749632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application yield resource Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise self.value Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application session.commit() Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 20:46:11.750601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.flush() Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application compat.raise_( Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 20:46:11.751489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:46:11.752439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:46:11.753278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [parameters: {'id': '547975f4e2854382ae3b56bb78bb89e5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:11.754089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 20:46:11.754986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:11.755884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 233/478] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 4 20:46:11 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:11.757129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:11.793567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:11.899577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22489-569b-4d81-a675-9723742c80ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:11.937499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:11.938417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:11.938842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:11.939262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:11.949974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f3592aae-c184-42de-b13c-b49a7329017e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:11.955536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:11.956675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 20:46:11.957719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:11.960099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 246/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:11.965882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:12.075272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75142bdf-5687-44dc-9366-f3292a6002a8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:12.111001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:12.112029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:12.112454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:12.112869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:12.113728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:12.114176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:12.115719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344bfa-c714-4c7b-a5b0-b5c4fc93b9aa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:12.125825 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 234/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:13.185803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b604-7a24-4c81-9775-8105c5d88170 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.186346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b604-7a24-4c81-9775-8105c5d88170 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.186346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b604-7a24-4c81-9775-8105c5d88170 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.188035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 247/481] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:13.193357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.193782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.193921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.212974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:13.214176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:13.251480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:13.291864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 235/482] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:13.309964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30b604-7a24-4c81-9775-8105c5d88170 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:13.393912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:13.420012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30b604-7a24-4c81-9775-8105c5d88170 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:13.455391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:13.456151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.456438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.456718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.467603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c3dd010e-5eba-4f8d-996d-71f0a1bc38cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:13.472620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:13.473543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:13.474339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:13.479219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 248/483] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:13.480609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:13.568306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d35b1-3940-4e9e-bab6-5f22d8381702 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.568635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d35b1-3940-4e9e-bab6-5f22d8381702 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.569086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d35b1-3940-4e9e-bab6-5f22d8381702 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.571473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 249/484] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:13.576453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b236-c874-45e3-a375-e85897d0ae54 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.576739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b236-c874-45e3-a375-e85897d0ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.577065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2b236-c874-45e3-a375-e85897d0ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.611590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b9c2b236-c874-45e3-a375-e85897d0ae54 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:13.612832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9c2b236-c874-45e3-a375-e85897d0ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:13.615941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5442-5ad8-48c3-85a4-ff19dfe20fff None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:13.675208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:13.675870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.676150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.676448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.677140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:13.677443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:13.678906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7036d-5458-4a30-bc94-b0dfceb607a6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:13.687514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 236/485] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:13.688733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3b2e-b40a-4c49-b2b3-9bc5bc319537 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.689023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3b2e-b40a-4c49-b2b3-9bc5bc319537 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.689294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3b2e-b40a-4c49-b2b3-9bc5bc319537 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.690500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 237/486] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:13.695094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3b2e-b40a-4c49-b2b3-9bc5bc319537 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:13.720465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 250/487] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:13.722321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.722868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.723345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.743721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:13.745781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:13.752553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:13.822084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:13.834581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3b2e-b40a-4c49-b2b3-9bc5bc319537 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:13.835979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 251/488] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:13.836895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:13.875488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:13.876854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:13.877587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:13.878040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:13.896809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:13.899176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:13.920387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:13.921326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:13.922177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:13.922177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:13.922177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:13.922177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:13.924692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 238/489] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:13.925630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:13.967673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0d5d-66b7-4337-a65a-bf644375ec72 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.012358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.013992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.014377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.014798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.027708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:14.030961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:14.036413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:14.037464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:14.038278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:14.043778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 252/490] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:14.044780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.057076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b96df1-baef-474b-b50d-ecef2378e0c3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.104122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.105253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.105706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.106279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.113599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.120143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:14.127090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:14.128219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:14.129238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:14.132285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 239/491] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:14.133281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.167210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dea5e9-4baa-40f1-ac64-20425687b31c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.213348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.214140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.214525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.214914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.215732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.216165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.217642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.230320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 253/492] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:14.232368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.262639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaa9e8-a59e-4b41-8e19-f3ed03c79fca None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.299429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.300346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.300940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.301358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.302228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.302676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.304272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.313729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 240/493] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:14.314759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.326728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.348857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7842-6a60-467b-b4b1-a6ddf0510a88 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.366588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.389787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.391194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.391194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.391194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.392205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.392618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.394089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.404187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 254/494] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:14.405164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.423522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b809c-18b0-4571-837d-3486e02a0031 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.459504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.460470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.460931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.461375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.470316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.472004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:14.485519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:14.486479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:14.487419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:14.494144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 241/495] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:14.494144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.518593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66e2d3-b9a7-44ee-aed1-853febfcecfe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.556394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.557035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.557318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.557820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.562768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.570060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.572334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a48aa2ef-fd47-455d-a71b-f8fc8542ae39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:14.588008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:14.588909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:14.589817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:14.589817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:14.589817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:14.589817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:14.589817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 255/496] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:14.590810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209adc-9cb4-4daf-8fec-a703ca91ec33 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.590810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209adc-9cb4-4daf-8fec-a703ca91ec33 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.590977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209adc-9cb4-4daf-8fec-a703ca91ec33 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.592293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 256/497] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:14.592830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209adc-9cb4-4daf-8fec-a703ca91ec33 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.608011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41f38-3ae8-4c8c-b682-8fe592d57d57 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.627500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.646706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.647440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.647726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.648028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.659569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.661223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:14.676758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:14.677646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:14.678509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:14.678509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:14.678509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:14.678509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:14.678509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 242/498] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:14.678792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.711666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209adc-9cb4-4daf-8fec-a703ca91ec33 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.747411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.748052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.748329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.748598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.749380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.749682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.751100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bf898-d0d5-42a8-85a6-71ff5324deb4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.784561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28827-32bd-4afa-a954-89a326370f54 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.793987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 257/499] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:14.793987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.793987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.793987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.809099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.809679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:14.811045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:14.826369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.827084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.827370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.827644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.828471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.828888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.830313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:14.845517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 243/500] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:14.846193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.882376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 258/501] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:14.883661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:14.906901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:14.948363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80db1c3-877b-46a4-807e-a77cc95a8c73 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.986508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51990c4f-4987-46f5-9406-5ee95c182023 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:14.987205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:14.987871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:14.988161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:14.988431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:14.989125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:14.989438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:14.990832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ab7f-a1d9-49c4-a9b0-98db5ccc9915 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.002895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 244/502] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:15.004118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edadea8-e87f-4306-b56f-ec9311f6323f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.004402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edadea8-e87f-4306-b56f-ec9311f6323f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.004675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edadea8-e87f-4306-b56f-ec9311f6323f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.005891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 245/503] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:15.006579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edadea8-e87f-4306-b56f-ec9311f6323f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.027654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.028312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.028601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.028870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.049316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.097472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.098937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.107734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edadea8-e87f-4306-b56f-ec9311f6323f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.116260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.148467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.149337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.150126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.150407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.159760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.161233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:15.172923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:15.174038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 246/504] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:15.175300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.205093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 259/505] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:15.205944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.279847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.283439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679cd31-fa41-4fcd-9a97-d8b36f1b95cd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.303806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c998bc-9636-4b58-b4d5-9a8b73da95fe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.318412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.319048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.319329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.319609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.320550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.329676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-42105da4-e9b0-4a84-81c5-3e98933b0875 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:15.335123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:15.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:15.337395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 247/506] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:15.338090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.338261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.338508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.341286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.342150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.342439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.342714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.350050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.351491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.356367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:15.357550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:15.364916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:15.366044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 260/507] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:15.366976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.427361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 248/508] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:15.428226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.467703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d6601-82c9-4fd2-b00b-3aae2dbf3364 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.500646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63843198-df41-47de-8795-a93915bd593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.501246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843198-df41-47de-8795-a93915bd593b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.501526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843198-df41-47de-8795-a93915bd593b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.501796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63843198-df41-47de-8795-a93915bd593b None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.502582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63843198-df41-47de-8795-a93915bd593b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:15.502888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63843198-df41-47de-8795-a93915bd593b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.504370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63843198-df41-47de-8795-a93915bd593b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.519188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.522200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 261/509] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:15.523211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63843198-df41-47de-8795-a93915bd593b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.529525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67125-f8de-4e29-a597-46c5f7f2b148 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.560750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.565062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.565709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.565993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.566274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.576927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.578415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:15.593930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:15.594808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:15.595706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:15.595706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:15.595706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:15.595706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:15.595706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 249/510] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:15.596017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.627103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63843198-df41-47de-8795-a93915bd593b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.661006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.661619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.661907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.662182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.662894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:15.663211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.664632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.672930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 262/511] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:15.673708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.698985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eab03-a37d-4fcf-8f6e-6405abf75653 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.731602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.732247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.732528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.732804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.733593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:15.733907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.735343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.766778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.769477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.770523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 250/512] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:15.772593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.772786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb3b6-6b9c-467e-b0b0-8f8e7979d52c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.807995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.808626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.808907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.809184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.819632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.821136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:15.835246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:15.836307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 263/513] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:15.843184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.870318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9f454-d6e1-4018-9fb3-d00d43f50b45 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.905592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.906203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.906481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.906751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.937687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c557d56-a703-433d-b72b-cb75e9041c84 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:15.970317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:15.970696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:15.971307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:15.971640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:15.971892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:15.972581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:15.972892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.973558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:15.974270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.975630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:15.986293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 264/514] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:15.987095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:15.999352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.076500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 251/515] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:16.077259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.085741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859da18-846e-4884-8f50-d767e54a1a7f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.120318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.121182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.121464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.121738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.131637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.133119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:16.147850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:16.148911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 265/516] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:16.150028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.176455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.179800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5ecc-b529-458d-8f11-674309651f5b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.214710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.214888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.215325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.215639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.215987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.254212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44e2b1-b415-4617-ac2f-61eef8ecb1c2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.286631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.287119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.287557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.287867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.288136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.288237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.288821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:16.289126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.291010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.302484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 266/517] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:16.303286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.387079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.391062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 252/518] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:16.391940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.404940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3debeb-a814-4283-b1c4-b018dfa55c75 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.428041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.440342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.440976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.441256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.441529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.448068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.449518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:16.461251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:16.462328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:16.463191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:16.467075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 267/519] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:16.467951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.502444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22660a8-b26e-4edd-8e7e-15ff3ba2b174 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.536807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.537442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.537724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.538001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.547960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.549399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:16.564460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:16.565403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:16.566321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:16.566321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:16.566321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.566321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:16.566321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 253/520] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:16.566604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.572270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05417c-88f8-406d-b770-4167bd382e66 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.604796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.605424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.605720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.606396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.607083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:16.607394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.608827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.619144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.620957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 268/521] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:16.621884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.663241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.669790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392daaf-4bc3-4dc8-96a5-873e4358ca24 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.703279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.703926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.704206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.704480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.705159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.706632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.719659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459218-5b87-4f66-bbdd-af3adaa1f5db None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.727709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 254/522] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:16 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:16.729246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.765462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.766174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.766453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.766733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.781138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.782649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:16.801387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:16.802365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:16.803223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:16.803223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:16.803223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:16.803223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:16.803223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 269/523] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:16.804159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.849931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72d8ce-1aa9-4f01-aef4-22d8553efd6e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.861446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.896173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.896803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.897087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.897752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.898118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:16.898429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.900494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.910962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:16.920520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982b34e-d456-4bb0-9485-8f8c73eb6b73 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:16.922752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 255/524] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:16.925299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:16.958275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:16.958900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:16.959500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:16.959810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:16.960513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:16.960822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:16.962777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:16.979855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 270/525] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:16.979855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.036253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913541d9-5a50-4dac-92ca-2736383e015f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.073101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.074176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.074461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.074889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.082296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.083900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.086359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df862f-360e-4b35-a8eb-1d3c91871c94 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:17.096717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:17.097876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:17.099107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:17.100126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 256/526] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:17.105116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.130657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.131547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.131860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.132305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.133043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.133315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.134171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.136057 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.155447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 271/527] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.156355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.173480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.208779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5061-c6bc-46e6-80e3-458ea0917ff8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.244094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.244719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.245003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.245281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.246066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.246377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.247866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.264015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 257/528] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.264015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.292630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53e47-4f8b-46ab-b3b2-c36f03468c3f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.335256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.335942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.336228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.336501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.344366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.346028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:17.359066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:17.360116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:17.360969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 272/529] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:17.361435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.364894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.376453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bb09c-ed99-42b4-9e45-42647f71e725 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.416139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.416853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.417135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.417413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.418283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.418599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.420130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.446753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 258/530] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.446753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.482619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.519049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebb96-31de-4897-9c61-df6e55c301e6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.558834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.559847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.560330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.560851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.568118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.569532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec79a4-ddf8-416e-af24-fdd876b9c938 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.570032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:17.582316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:17.583203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:17.584103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:17.586140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 273/531] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:17.587699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.612202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.612832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.613127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.613429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.614134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.614441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.616036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.634137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 259/532] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.634137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.643072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.701201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53f874-2dd1-47c8-9ef2-f8c9e072f13f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.736699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.737681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.738217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.738688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.741628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.741758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3f376-7500-484e-8901-450d0f451258 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.780355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.780983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.781266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.781541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.782296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.782605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.784337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.797754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 260/533] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.798585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.816092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.817893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.878744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:17.912210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fabb30-d25e-478d-8b7d-77d879d13759 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:17.929307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 274/534] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:17.930556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.949772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:17.950505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:17.950770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:17.951045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:17.951924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=c49b3e48a8784ac5894e8399a737f3f5) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:17.952183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:17.953629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:17.959499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 261/535] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/role_assignments?user.id=c49b3e48a8784ac5894e8399a737f3f5&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:17.967956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:17.977871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:18.071881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774070-9230-41df-aee8-00100f0fbd92 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.100197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00e28-9a32-46ed-8dfd-73eebc30bdac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.115569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.116267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.116550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.116827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.136292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.137809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.140079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:18.167930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:18.168884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:18.169754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:18.169754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:18.169754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:18.169754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:18.170427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 262/536] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:18.182975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.183594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.183900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.184175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.184960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=31f9af670ced484a8c829f245bd08ac4) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:18.185270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.186703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.189057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:18.203120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 275/537] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:17 2022] GET /identity/v3/role_assignments?user.id=31f9af670ced484a8c829f245bd08ac4&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:18.309759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df88ba3-7456-4ead-bc55-ad70a1f74708 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.355556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.356234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.356522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.356800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.357515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:18.357822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.359243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.373532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 263/538] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:18.379681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:18.523523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:18.527733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941204b-1467-433b-a8d0-a08b2b748099 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.576472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.577123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.577407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.577684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.585041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.586511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:18.604364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:18.605268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:18.606133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 276/539] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:18.612761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:18.663843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:18.718670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd5a3-48f6-4b75-977f-c82722c34044 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.753661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.754283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.754566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.754844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.755597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:18.755986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.757439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82516c-270a-4594-8659-a799c590f1b0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.769537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 264/540] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:18.776682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:18.896856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f597d-acb0-4f5f-862d-6cf6f242f282 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:18.933817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:18.934441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:18.934723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:18.934998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:18.935815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=ffeab70f281f498cad508880727ca637) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:18.936129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:18.937559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf40a85-a4b5-4593-819d-99005968d0c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:18.947963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 277/541] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:18 2022] GET /identity/v3/role_assignments?user.id=ffeab70f281f498cad508880727ca637&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:19.089969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11925811-9f66-4eb2-a9f7-26cc02057acb None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.090267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11925811-9f66-4eb2-a9f7-26cc02057acb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.090459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11925811-9f66-4eb2-a9f7-26cc02057acb None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.092195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 265/542] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:19.097499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.097778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.098051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.119639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:19.120898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:19.138974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:19.194190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 278/543] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:19.229251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11925811-9f66-4eb2-a9f7-26cc02057acb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:19.370592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11925811-9f66-4eb2-a9f7-26cc02057acb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:19.378237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:19.415699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:19.416391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.416676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.416955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.435281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-fad3e5a9-2739-4e6e-a62f-ee6f92bf8e64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:19.440874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:19.441759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:19.442589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 266/544] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:19.448677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:19.534184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675630d1-ae98-4978-a122-443219e7f0de None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.534532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675630d1-ae98-4978-a122-443219e7f0de None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.534740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675630d1-ae98-4978-a122-443219e7f0de None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.536435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 267/545] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:19.542018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.542305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.542582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.572791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:19.574121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:19.614698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3804936-284a-4a87-8150-8996d8669a12 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:19.663567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:19.664218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.664499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.665365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.666217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:19.666520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:19.667914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:19.687206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 279/546] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:19.687380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 268/547] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:19.692849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:19.718621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:19.754666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:19.868669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:19.878705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b1415-0a5a-479b-a8e0-3874a2dffe79 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:19.910642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a527ade-6748-4de1-8bb0-a6f80987e20a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:19.950786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:19.951381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.951669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.951975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.959593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:19.960258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:19.960536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:19.960802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:19.968525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:19.969988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:19.971064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:19.976501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:19.977931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:19.978765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:19.983053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 280/548] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:19.984242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:20.004380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:20.006429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:20.009175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:20.009175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:20.009175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:20.009175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:20.009175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 269/549] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:20.015506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.089300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac691e1-4691-413a-921c-34fd1c6155e0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.090951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.144302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.144922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.145204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.145478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.146195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:20.146501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.148049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.161651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 281/550] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:20.162891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.257769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca0a8-6d84-4d3a-8b3e-3ed5b05f5daa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.291628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b6ebf-1935-4650-bd27-6cc7e3011856 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.299209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.299874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.300156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.300426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.301125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:20.301427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.303278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.320002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 270/551] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:20.323322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.335022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.404216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.404863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.405147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.405473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.417105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.435776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88532-14a7-4025-a11d-9c20543a6587 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.436594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.438139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-92fd959e-fef6-41c4-aafd-6e701bddf366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:20.454903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:20.456013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:20.457242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:20.457242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:20.457242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:20.457242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:20.459298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 282/552] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:20.460746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500a35-cde8-4a45-a16b-4f1b15dc5468 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.461236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500a35-cde8-4a45-a16b-4f1b15dc5468 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.462267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500a35-cde8-4a45-a16b-4f1b15dc5468 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.467909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 283/553] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:20.469552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.470092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.470615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.482175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.482824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.483105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.483378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.491683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.492205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:20.493694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.494369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:20.508881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:20.509885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:20.510937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:20.514682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 271/554] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:20.515514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.579044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 284/555] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:20.580410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.599614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.646207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a607-b7de-4c28-885d-6d802d329725 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.683110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.684195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.684686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.685192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.686090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:20.686609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.688275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.702866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 272/556] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:20.704114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.712773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bec09-4595-4316-881f-3a44e6bb8e65 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.731592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.751379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.752022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.752400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.752683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.753483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:20.753786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.755219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.777814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 285/557] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:20.777814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.826793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711399d-e81c-4076-8763-ba6283612dc4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.855531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:20.864272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.864912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.865201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.865474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.876067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:20.881199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:20.882817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 273/558] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:20.883765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.884555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ad4e-746a-4245-9451-94f5573f7192 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:20.925642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:20.926286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.926568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.926844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.934634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:20.936105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-745d7d42-99e5-4668-82cc-83e49e533b2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:20.950172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:20.951184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:20.952319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 286/559] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:20.952942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983d4b-3b82-4747-b558-2d9e60690d0d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:20.952942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983d4b-3b82-4747-b558-2d9e60690d0d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:20.953975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db983d4b-3b82-4747-b558-2d9e60690d0d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:20.954483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 287/560] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:20.955083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983d4b-3b82-4747-b558-2d9e60690d0d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:20.994668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.005481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a53b-04ed-41cc-9c06-70355c44b701 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.041246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.041842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.042128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.042397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.067364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db983d4b-3b82-4747-b558-2d9e60690d0d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.099754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.105475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.106364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.106786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.107210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.108004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:21.108382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.109968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f405c1e-ddac-4617-ac38-0efe523f6689 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.113998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.115671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.120176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 288/561] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:21.121694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.122137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.122416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.140773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:21.142079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:21.224032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 289/562] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:21.225659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.233698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 274/563] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:21.234618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.255737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.326123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.332523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd30981-6673-469c-a26f-1b9276663ff4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.338822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4938-a3dd-4e1a-ab06-0115945cf2b3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.365901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.366516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.366797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.367078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.367920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:21.368232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.369656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.372637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.373273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.373559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.373838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.384272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.385710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.386650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 290/564] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:21.387609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:21.401052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:21.402000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 275/565] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:21.403211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.474569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.490259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72cec-8201-4240-b490-51d17c4dd719 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.507058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192d9d9-5456-4fbf-bf93-e3da0e483b57 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.524180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.524813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.525089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.525358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.535360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.536832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.541754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.542394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.542680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.542956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.550739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-295d7a23-9342-404f-82e2-2023768748a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:21.551811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:21.552869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:21.553820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:21.553820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:21.553820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.553820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:21.553820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 291/566] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:21.554861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2f84-2a68-49c9-b963-2539e0c758cf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.554984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:21.555142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2f84-2a68-49c9-b963-2539e0c758cf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.556010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f2f84-2a68-49c9-b963-2539e0c758cf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.557424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 292/567] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:21.558025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2f84-2a68-49c9-b963-2539e0c758cf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:21.565287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:21.567033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 276/568] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:21.567969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.660504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f2f84-2a68-49c9-b963-2539e0c758cf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.668824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10ceb-9ab9-44e8-9c89-cf05e2e8eacb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.693800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641666-a758-4db5-9142-981357efa074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.694434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641666-a758-4db5-9142-981357efa074 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.694709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641666-a758-4db5-9142-981357efa074 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.694975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641666-a758-4db5-9142-981357efa074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.701782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.702166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.702394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.702674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.702946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.703639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:21.704326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.705864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.706151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641666-a758-4db5-9142-981357efa074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.707923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641666-a758-4db5-9142-981357efa074 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.717853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 277/569] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:21.718649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-74641666-a758-4db5-9142-981357efa074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:21.728452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:21.729687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:21.730627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:21.730627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:21.730627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:21.730627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:21.730627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 293/570] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:21.731098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.731419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.731595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.748850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:21.750024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:21.780761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.816101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 294/571] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:21.816932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.829408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76650-65da-4cd2-a5d1-a36503a043e8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.865643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.866258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.866542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.866820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.867507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:21.867874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.869250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.880223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 278/572] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:21.881001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.919225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e532f4c-c316-4160-b5ab-a21879824b74 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:21.938426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:21.953101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:21.953720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:21.954001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:21.954275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:21.954980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:21.955282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:21.956682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:21.965016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 295/573] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:21.965792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:21.980169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dff50-10e5-4139-a8eb-b4db218c4830 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.000348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.014958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.015596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.015904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.016178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.023701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.025708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:22.036884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.042661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 279/574] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.043977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.065010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e509-7cc0-440b-b434-56cd7b88d9ac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.098062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.098675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.098959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.099226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.099940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.100242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.101625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.113527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 296/575] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.114304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.140984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd24430-689d-4e84-9e75-fabd97889e19 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.158122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.175080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.175653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.175967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.176250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.186388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:22.191824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.192962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 280/576] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.193852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.216865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b97d60-612b-49d5-b077-3ed3827d7c29 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.235319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.250751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.251388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.251669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.251970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.259077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.260545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:22.272226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.273298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 297/577] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.274577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.297474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5efa6-c775-4916-9c6d-01e32e934e07 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.331401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.332077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.332361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.332639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.344946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.346401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:22.361037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.362109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 281/578] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.367695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.374260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bf81-eb37-4a03-b763-9d5513521d31 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.375833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.408400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.409266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.409546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.409822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.410615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.410922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.412384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.429688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 298/579] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.430484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.464242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.473519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d95a22-7275-4bd5-b0bf-e68d68cf7d46 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.507368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.508052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.508382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.508660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.515414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.517017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:22.529335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.530341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 282/580] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.531259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.538807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cd78f-8534-4cc9-bc41-a192c88d3c6a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.580014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.580633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.580913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.581186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.581926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.582231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.583601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.592833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 299/581] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.593723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.618442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.635012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed116924-dd91-4345-acd8-17bccd2e3bd6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.669398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.670018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.670301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.670576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.671315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.671624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.673094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.685000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 283/582] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.685713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.699437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.700302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77248f1-e6a3-480b-a193-896505b66d09 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.734097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.734710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.734981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.735260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.735992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.736301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.737684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.749214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 300/583] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.749943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.787231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79056a-e758-471c-8666-3f696492eb4b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.820891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.821526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.821814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.822088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.829422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.832215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.833716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.848836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2185c1-e846-4ffb-8205-5e14cc937834 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:22.848972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:22.850019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:22.851128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:22.851128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:22.851128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:22.851128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:22.854827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 284/584] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:22.855701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.885873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.886483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.886762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.887034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:22.887805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:22.888116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:22.889565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:22.908187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 301/585] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:22.909271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:22.918763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:22.957630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517a3c-c075-4950-93dc-66e44af87d84 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:22.990234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:22.990877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:22.991169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:22.991448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.003528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.005125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.006428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70508e-e864-4112-a667-dcfba9f94968 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:23.019074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:23.020171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:23.021217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:23.021217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:23.021217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:23.021217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:23.021217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 285/586] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:23.022327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.041096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.041710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.041994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.042270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.043052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.043362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.044837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.050193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 302/587] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:22 2022] GET /identity/v3/role_assignments?user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:23.051003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.071651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.136937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff942c76-771e-4d47-b50b-41d908742f7b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.156721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.176195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4335-7982-4d63-aa90-1ff3e8f48880 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.177922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.178676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.179060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.179430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.188072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.189543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:23.203624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:23.204692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:23.205886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:23.208166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 286/588] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:23.209142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.217239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.217998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.218386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.219204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.220053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.220467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.222652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.235704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 303/589] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:23.236605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.307815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.324172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f14a-366c-443b-84fd-dbcd75bde9ef None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.346110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081f7b-9448-4fc6-a9b3-65be1707c29e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.359675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.360866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.361255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.361664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.377790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=fff966e741314bb8b510713bff46a08c, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.379390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.381428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.382219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.382508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.382784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.384077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.384384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.386076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.393299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 287/590] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:23 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:23.394288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.413441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 304/591] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:23.414580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.431628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.540396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5138cde-73cf-4925-b677-9f7eeab2ec48 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.559339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b2989-de87-4fa3-aabd-a43dc1e3a55b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.582045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.583126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.583564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.584321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.585281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.585766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.588420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.595383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.611445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 288/592] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:23.611816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.612364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.612856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.613452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.613878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.624026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.626449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:23.641687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:23.642810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:23.643934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:23.650067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 305/593] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:23.650067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.724178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.745178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d6cfe-0ac5-4246-918e-a59ace686d3e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.776346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ad7b-a970-4e36-b7e7-2f7c7fe039cb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.785254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.786293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.786784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.787267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.795832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.797707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:23.811652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:23.812731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:23.813708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:23.814263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.814263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.814263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.814263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.816597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 289/594] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:23.817698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.826500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.828106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:23.842886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:23.843844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:23.844787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:23.844787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:23.844787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:23.844787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:23.844787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 306/595] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:23.845680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:23.887400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:23.932361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a551f-df37-4258-a286-5f149a12b674 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.950329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b7b91-943d-4541-bf71-0fb1df1ac4ac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:23.969208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.970187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.970681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.971272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.972262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.972785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.974681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.986002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:23.986679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:23.986967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:23.987243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:23.988071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:23.988379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:23.994328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:23.994592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 290/596] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:23.995671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.000010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.008473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 307/597] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:24.009114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.108972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.111607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968134-e165-46c4-b1a3-83650d2b57cc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.114883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377caa7-5026-4a21-8823-d0f7e1732329 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.150953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.151691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.152002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.152279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/c49b3e48a8784ac5894e8399a737f3f5/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.152402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.153178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.153607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.154031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.155042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:24.156355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.158001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.167509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=c49b3e48a8784ac5894e8399a737f3f5, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.168988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.173181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 291/598] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:24.174465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.186072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 308/599] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:24 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/c49b3e48a8784ac5894e8399a737f3f5/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:24.187005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.303255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded910f4-4892-4534-9fe9-c7f6d1f168af None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.323770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.345104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.346104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.346579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.347039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.361167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.363094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:24.377292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:24.378218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:24.379136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 309/600] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:24.381823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a164-dd50-4e0d-a950-5f60d81e381b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.384704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.393908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.426330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.426981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.427264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.427538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.441685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.443699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:24.467053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:24.469101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:24.470513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:24.470513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:24.470513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:24.470513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:24.470513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 292/601] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:24.476706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.499921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423f368-fa24-4220-ac97-f57a1abd83c5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.535795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.536422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.536703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.536979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.537726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:24.538096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.540167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.553401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 310/602] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:24.559297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.629342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.667516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228eea-fa80-4e4b-b3d8-4c224e435af9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.674448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7d573-4105-4de8-b8e3-13c6a0d756b8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.703566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.704164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:24.704282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.704532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.704807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/31f9af670ced484a8c829f245bd08ac4/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.719663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.720333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.720620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.720899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.721598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:24.721907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.723321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.739617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 293/603] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:24.742894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=31f9af670ced484a8c829f245bd08ac4, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.744495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.745524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:24.774927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 311/604] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:24 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/31f9af670ced484a8c829f245bd08ac4/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:24.868886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43c6c3-4fc0-46d0-a505-83ac7e4866bc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:24.905583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:24.906247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:24.906531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:24.906807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:24.914831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:24.916342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:24.928818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:24.929814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:24.931280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 294/605] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:24.936519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:25.062886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4d9e-d205-4a1f-bd69-7702ad116f10 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:25.080173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:25.103018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:25.103597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.103909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.104183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.104937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:25.105244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:25.106750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e0f7-8051-4396-a2a8-172efaa40c31 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:25.120788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 312/606] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:25.126727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:25.180773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:25.264722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd5f71-f70f-4212-be4d-b99eae41a291 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:25.300815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:25.301504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.301795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.302081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/ffeab70f281f498cad508880727ca637/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.317879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=ffeab70f281f498cad508880727ca637, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:25.319343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61def3cb-3617-4d7d-88c4-7d2807ac1f56 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:25.335688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 295/607] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:25 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/ffeab70f281f498cad508880727ca637/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:25.367165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e2df-3ab8-4d47-bccc-cd32a842f26c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.367510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e2df-3ab8-4d47-bccc-cd32a842f26c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.367817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e2df-3ab8-4d47-bccc-cd32a842f26c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.369667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 313/608] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:25.375291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18623-b848-4750-a0de-82b0e7c29bd5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.375530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18623-b848-4750-a0de-82b0e7c29bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.375830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c18623-b848-4750-a0de-82b0e7c29bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.398134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-13c18623-b848-4750-a0de-82b0e7c29bd5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:25.399528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-13c18623-b848-4750-a0de-82b0e7c29bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:25.476056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 296/609] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:25.517251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e2df-3ab8-4d47-bccc-cd32a842f26c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:25.662442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e2df-3ab8-4d47-bccc-cd32a842f26c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:25.709831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:25.710481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.710762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.711035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.718746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89f03-11e4-4008-a491-1a54aec4dd8d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.719274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89f03-11e4-4008-a491-1a54aec4dd8d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.719274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89f03-11e4-4008-a491-1a54aec4dd8d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.720920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 297/610] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:25.725647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:25.726046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.726341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.726625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:25.730778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:25.731945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:25.732824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:25.734578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 314/611] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:25.738063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:25.775974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:25.776893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:25.778178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:25.805916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:25.848254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af343d2-317e-4238-b25b-478c16d77f08 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:25.884248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:25.885190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:25.885641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:25.886159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:25.887029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:25.887581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:25.889120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:25.901755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 315/612] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:25.903694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:25.933036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 298/613] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:25.967529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.007379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:26.012468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff4ab-1e4d-4f6b-ad9d-c7e27fcbb1bd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.078791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.079443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.079724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.080026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.104574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.106052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:26.138511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:26.139471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:26.140500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:26.140500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:26.140500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:26.140500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:26.144440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf0a9-c63a-499e-aed6-a31518774328 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.146120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 316/614] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:26.146989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.182108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.182761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.183100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.183321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.194807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:26.201034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:26.202053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:26.203528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 299/615] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:26.208308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.229221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:26.364135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467c7a-ebec-4c33-abe2-3b52d126108f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.369660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc7ae-bd64-4e04-90bf-5229d1bdb3e4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.408669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.409306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.409579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.409883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.410579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:26.410884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.412590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.423540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 300/616] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:26.430210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.442777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.444242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.448322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.449140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.450579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:26.454114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.455902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.479997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 317/617] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:26.486112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.504974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:26.601038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b34e3-7aca-4995-b603-25022a7de644 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.638333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.638984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.639266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.639541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.649731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.652622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.660328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:26.667358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:26.668427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:26.669476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:26.673208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 318/618] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:26.674453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.706125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73173-18d0-4864-a9ed-37f40be6c3c5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.745531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.746200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.746447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.746722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.770351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.771848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:26.799560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:26.800571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:26.801635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:26.801635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:26.801635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:26.801635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:26.803397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:26.804320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 301/619] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:26.810008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.874178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51b72a-1959-4e31-bd00-f45640451209 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:26.939974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:26.940602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.940886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.941167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.941975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:26.942285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:26.945027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a5583-acdf-4517-9f4b-542adb2cd1cb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:26.981069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 319/620] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:26.985181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b941be-beeb-4e79-885b-24568584389c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:26.985699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b941be-beeb-4e79-885b-24568584389c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:26.986178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b941be-beeb-4e79-885b-24568584389c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:26.987900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 320/621] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:26.988808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b941be-beeb-4e79-885b-24568584389c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:26.994301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1e75-6bdd-40d4-98e3-149b3483f9ff None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.019762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.039277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.040076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.040428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.040779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.041556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:27.041930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.043832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc811f1b-9942-4df1-839f-4d092df4b95e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.059685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 302/622] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:27.064342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.064342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.064342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.083198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:27.084545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:27.116560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b941be-beeb-4e79-885b-24568584389c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.149772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.160408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.161374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.161877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.162564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.173606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 303/623] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:27.174591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.186653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.188640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:27.217029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:27.218004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:27.218917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:27.218917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:27.218917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:27.218917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:27.221240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 321/624] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:27.222440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.297332 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc0e89-790b-4459-bbc0-931c158814d6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.311519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.329959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1aabd-2044-4800-a461-9fbda651ecc3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.337216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.337862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.338139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.338410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.346419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.347918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:27.361751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:27.362759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 304/625] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:27.363728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.375825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.376531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.376813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.377171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.389029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2395be63-c4f7-42f8-a7e3-347c900313dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:27.395012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:27.395995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 322/626] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:27.402810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb4e2-c51e-4053-9a62-0b4b63e40ba9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.403869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb4e2-c51e-4053-9a62-0b4b63e40ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.403869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb4e2-c51e-4053-9a62-0b4b63e40ba9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.403869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 323/627] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:27.404999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb4e2-c51e-4053-9a62-0b4b63e40ba9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.452955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.485091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110cbdf-7972-48ac-bf49-304173ca9e13 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.521341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb4e2-c51e-4053-9a62-0b4b63e40ba9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.521526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.521990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.522277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.522556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.523521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:27.524532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.525916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.542645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 305/628] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:27.542645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.564822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.565456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.565745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.566016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.566809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:27.567122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.568587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f0861-3cc3-4422-858c-e5a00fadc0ca None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.573877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.593925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 324/629] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:27.595231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.595525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.595827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.613478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:27.614674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:27.647434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a944-d94a-4b03-88d4-3975e09f7b16 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.684142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.685043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.685333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.685616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.686337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:27.686648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.688064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.699977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 325/630] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:27.699977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.714234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 306/631] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:27.715364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.727278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.804060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4779cf-8c7e-47b6-8ca3-5749f178d14c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.813146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.822858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393acb06-c451-4ffa-883a-fa13e405b8f2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.837934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.838564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.838840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.839109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.845591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.847006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.856774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.857395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.857678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.857954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:27.858239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:27.859322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 326/632] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:27.860472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:27.930431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:27.931935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1496d-34ae-4ec2-8057-1cce7966afd8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:27.947212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:27.959409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788e92-ca6f-40d2-a48d-e77f5dc0815c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:27.992014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:27.993273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:27.993551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:27.993821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.004865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.006305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.020099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:28.020280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.021140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.022103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:28.022103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:28.022103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.022103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:28.022103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 327/633] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.023004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.034533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 307/634] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:28.035772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fd0b-1e76-45a6-9b3f-3a7e1205ec8f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.036077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fd0b-1e76-45a6-9b3f-3a7e1205ec8f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.036351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fd0b-1e76-45a6-9b3f-3a7e1205ec8f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.037754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 308/635] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:28.038262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fd0b-1e76-45a6-9b3f-3a7e1205ec8f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.126862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57dd1ec-aeaf-45f9-8468-d973821a8c94 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.138266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fd0b-1e76-45a6-9b3f-3a7e1205ec8f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.159997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.160636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.160920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.161199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.169317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.172528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.172914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:28.173135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.173416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.173691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.174434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:28.174743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.176210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:28.178041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.179029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 328/636] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.180084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.195974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 309/637] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:28.195974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.242370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.278959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b9b61-3484-4b2f-93e2-46402bf2b561 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.290406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea19740-3fe8-488b-a167-4c766f3cc531 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.311170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.311794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.312073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.312446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.313127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:28.313427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.314793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fc44-2c02-43ff-bab9-1a5ea20f22dd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.323181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.323839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.324119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.324390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.326985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 329/638] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:28.328189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.328474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.328749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.336155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.337597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.345497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:28.346684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:28.353062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.354139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 310/639] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.359593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.401755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.414089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 330/640] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:28.415385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.457298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d9697-6281-4ec2-b228-3ab62dd37ab2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.460605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.495271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.495930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.496219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.496499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.497211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:28.497519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.498903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.506750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 311/641] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:28.507531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.528361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266692ff-decb-4170-839c-460b9c5fb9bd None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.561283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.561948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.562226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.562498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/dc7e41de613b48f9a9cb7e0a5ceb0aa6/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.576729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=dc7e41de613b48f9a9cb7e0a5ceb0aa6, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.578146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.590245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 331/642] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:28 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/dc7e41de613b48f9a9cb7e0a5ceb0aa6/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:28.591060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.622639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1715-3fe8-4e81-9a9c-b4cfa596d629 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.639846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.665700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.666627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.667055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.667518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.676709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.678567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:28.692063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.693184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 312/643] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.694187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.713390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee940c-9d1b-4814-b4fb-5850cb06dd94 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.726872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.759344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.760077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.760408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.760687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.761463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:28.761800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.763243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.775655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 332/644] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:28.776323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.815896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a277a-6ce3-4ad6-9d36-51ab730791a8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.857287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.858247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.858688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.858962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.870101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:28.875429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.876442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 313/645] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.877470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.882691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.886187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558a66b-20cc-4f82-ac5e-8264379a0e14 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:28.922551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:28.923109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:28.923393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:28.923670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:28.934830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:28.936318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:28.951050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:28.952053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:28.952951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:28.952951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:28.952951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:28.952951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:28.952951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 333/646] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:28.953669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:28.974784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:28.994708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0e99-e5ef-4746-b635-48290d886d77 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.030641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.031271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.031558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.031867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.032660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:29.032971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.034664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.055791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 314/647] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:29.055791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.060636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313beb8-ffac-48e0-8e58-190140c6e244 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.095085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.095728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.096039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.096306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.103826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.105288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:29.116623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:29.117591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:29.118500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 334/648] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:29.119131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.139508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.172673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ca768-2533-49bc-9e66-b102820a6739 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.208018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.208637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.208919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.209191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.209892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:29.210194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.211665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.223906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 315/649] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:29.224807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.234124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.239472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5cf7d-ebaa-4514-b9c7-f2119f8c48ee None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.274941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.275556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.275860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.276136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.276828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:29.277129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.278494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.291455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 335/650] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:29.292297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.343766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9566f2-eca5-49ad-a54e-d3856a367771 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.370582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.380372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.381001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.381286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.381563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.402076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13d51a-3eee-4c39-956f-067ac902617c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.438549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.439139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.439425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.439700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.440478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:29.440788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.442228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.453654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.455123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.457317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 336/651] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:29.459112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.469702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.560414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 316/652] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:29.561348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.573799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6c72-3c2f-40fd-9bc3-04c1f9e6ac74 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.606903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.612904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.613554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.613839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.614116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.625742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.627215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:29.642676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:29.643697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:29.644645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:29.644645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:29.644645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:29.644645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:29.644645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 337/653] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:29.644937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.671342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6c340-c983-4352-b020-ffccc7ae67aa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.678849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.708291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.708866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.709155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.709428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.716973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.718465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:29.731900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:29.732883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:29.733842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 317/654] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:29.734461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.756457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9ed23-63be-4f45-8ae2-00d4ac0a4971 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.801166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.802134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.802598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.802854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.803650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:29.803994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.805460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.819782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 338/655] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:29.819782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.854633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb38cc-8956-4582-a890-48333f682454 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.887379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:29.896123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:29.897090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:29.897558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:29.897985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:29.911777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:29.913547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:29.929935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:29.931032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:29.931998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:29.931998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:29.931998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:29.931998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:29.933908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 318/656] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:29.934912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:29.953746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416258f5-14b8-4315-aec7-f50af7f5e558 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:29.960184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.000296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.001827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.002541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.002963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.003983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:30.004461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.006375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.019494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 339/657] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:30.020252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.068971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8b9c8-ccb5-445d-842d-156bceb7c2d5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.115919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.116824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.117800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.118222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.119171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:30.120117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.121811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.146432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 319/658] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 4 20:46:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:30.147528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.151776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f38ab-1daa-4421-bcc4-076286aacc60 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.180531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.188312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.188985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.189487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.189612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.190201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:30.190504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.191899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.204142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 340/659] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:30.205422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.254412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.287768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6949206-819c-4b72-90ad-74db359e5eaf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.308321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a273-bae1-44a2-979b-20e79b4991bd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.342801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.344303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.344976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.345510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.355379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.355954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.356079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.356284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.356557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.358160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:30.377274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:30.378383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 20:46:30.379438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:30.382656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 320/660] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:30.384069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.396054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.445454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.447949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.510586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2cd9-d292-4990-8e2d-7868e930adfb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.546007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.546859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.547116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.547503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.556820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.558945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.561182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:30.581677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:30.582878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 321/661] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:30.584757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.586557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 341/662] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:30.589097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.662136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.697209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945b6a-e08f-4ecc-a2ce-c89f8dc8e2ac None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.697733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802d35b-b5d1-4132-8ab7-867b60ede5cf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.733242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.733936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.734300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.734581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.734772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.735379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.735666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.735988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.736778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:30.737323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.738514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.746069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.747625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.757084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 322/663] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:30.758115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d9c94771-539d-4e6a-b1f9-258fac875eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:30.766391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:30.767489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:30.768459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:30.768459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:30.768459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:30.768459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:30.768459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 342/664] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:30.768924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538986a-362c-4ce8-a773-c2b40fba3edf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.769380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538986a-362c-4ce8-a773-c2b40fba3edf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.769990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538986a-362c-4ce8-a773-c2b40fba3edf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.771766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 343/665] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:30.776501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538986a-362c-4ce8-a773-c2b40fba3edf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:30.826726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.875649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2ad6-3f79-432a-be94-57c691f97dd8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.884082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538986a-362c-4ce8-a773-c2b40fba3edf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:30.906523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:30.917476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.918015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.918298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.918575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.919322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:30.919631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:30.921103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:30.924809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:30.925495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:30.925842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:30.926181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:30.933715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 323/666] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:30.934427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.004973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.007548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.038390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcb727-09de-4bc6-b025-f0b9e5c285f0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.053487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.075664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.076345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.076627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.076908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.077618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:31.077928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.079365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde21fbc-93b3-4227-9f6f-3ed7e8715f7f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.097250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 324/667] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:31.097250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.097250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.097250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.112655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:31.113841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:31.124791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 344/668] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:31.124791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.145447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.195772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 325/669] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:31.195772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.242006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93840b9-c896-4ef2-8807-8961ebb9f1b3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.282606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.283699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.284065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.284408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.285291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=c49b3e48a8784ac5894e8399a737f3f5) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:31.285696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.287167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.300437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 345/670] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/role_assignments?user.id=c49b3e48a8784ac5894e8399a737f3f5&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:31.301941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.305561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566497b-bd58-4b3b-ac7e-5e38931b70eb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.309422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.347374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.348479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.348972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.349443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.357858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.359739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:31.372914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:31.373924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:31.374855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:31.377643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 326/671] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:31.378814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.522649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437496-5eca-4897-843b-c9e2d52336dc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.554299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.564748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.565406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.565846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.566126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.573811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d768349-7a84-4dde-bdf8-5cfbd95d18fb None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.583293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:31.590484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:31.591531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:31.592686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 327/672] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:31.593630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.619016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.620209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.620938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.621659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.622099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.636873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.639106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:31.660081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:31.661197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:31.662291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:31.662291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:31.662291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:31.662291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:31.664821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 346/673] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:31.666474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.713939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a083-aa9c-4fc6-b1c4-cfb2fff9c9b3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.755147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.756556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.756556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.756556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.757571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:31.758032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.759576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.772721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 328/674] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:31.774330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.795680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0696a-355d-4acd-bbb2-37b332c94abf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.843001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.843950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.844387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.845023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.846574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:31.847035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.849106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.852741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.864873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 347/675] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:31.866007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.871795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:31.893556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2b0de-4dd7-4fd7-a133-14c5037470c3 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:31.942662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:31.943880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:31.944342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:31.944761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:31.946028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:31.947334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:31.948906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:31.961882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 329/676] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:31.962909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:31.984039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94760-bc11-483e-a488-c8c2c7d86b99 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.023615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.024557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.024840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.025112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.025902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=31f9af670ced484a8c829f245bd08ac4) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.026210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.028376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.035541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 348/677] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/role_assignments?user.id=31f9af670ced484a8c829f245bd08ac4&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:32.036383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.110955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84c183-7f1f-486f-8a13-884a3d621df7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.124238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.164583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.165540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.165832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.166114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.173121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc401ec8-1d6c-4971-8bd1-75719c059224 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.182728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.184810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.188570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-10d471da-f91d-4319-933a-7e295be99a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:32.206998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:32.208078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:32.209016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:32.209016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:32.209016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:32.209016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:32.209016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 330/678] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:32.209708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac64b-7138-4681-b578-7f863707ef45 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.210682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac64b-7138-4681-b578-7f863707ef45 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.210682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac64b-7138-4681-b578-7f863707ef45 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.212253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 331/679] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:32.216718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac64b-7138-4681-b578-7f863707ef45 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.219680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.220356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.220631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.220900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.230442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.232313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8158207b-cf12-44e2-9203-24caab57aa84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:32.244586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:32.246152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:32.247289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 349/680] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:32.248129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.248411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.248679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.269355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:32.273522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:32.343202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 350/681] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:32.343808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac64b-7138-4681-b578-7f863707ef45 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.344146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.381708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.382851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.383381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.383841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.384834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.385318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.386974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.397589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.404081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 332/682] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:32.405150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.449559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd056f8-8317-46ac-8330-d1e8934402ab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.468902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.500098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.501078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.501561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.502010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.503002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.503517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.505098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.518657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 351/683] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:32.519279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf13d1-2114-4d2b-99ce-753f6f66d6c8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.519961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.558958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.561134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.561563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.562004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.575721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:32.582844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:32.584058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:32.585116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:32.588945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 333/684] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:32.590031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.639597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a52560-19be-4c7b-8e93-f4203dfa66ae None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.657088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.683127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.683961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.684344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.684772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.693070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.694765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:32.707950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:32.709112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:32.710273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:32.712131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 352/685] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:32.713021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.731902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d1604-b13b-46e7-a07d-1c157a5cb0a8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.754975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.780874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.781958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.782386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.782923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.784173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=ffeab70f281f498cad508880727ca637) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.784892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.787202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.794947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 334/686] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/role_assignments?user.id=ffeab70f281f498cad508880727ca637&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:32.796484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.824631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59fb53-0c0a-416f-a033-bd07a6be37c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.864274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.865227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.865617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.866020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.867063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.867472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.869090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:32.884166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 353/687] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:32.885840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:32.927435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:32.939818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1519b0-3aa2-4e94-97f6-22d79447d5a4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:32.982923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:32.983844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:32.984611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:32.985047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:32.986377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:32.986859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:32.989474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.034559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 335/688] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:33.041244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.055589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb269b-2d98-4ef0-8a08-1507c3676096 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.091021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.100793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.102004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.102297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.102569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.117211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.118681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:33.133643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:33.134616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:33.135521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:33.135521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:33.135521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:33.135521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:33.140375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 354/689] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:33.141269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.158513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db166e-b055-4713-a1be-4bd39665f94d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.201583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.202138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.202426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.202709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.236528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.253386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea28e-6267-46e3-87a4-df412f801c92 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.281119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.282736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.290600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.291333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.291689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.292104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.292889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:33.293264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.294759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.309462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 355/690] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:33.314817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.352207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.394637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 336/691] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:46:33.400557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.421664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f0f39-c57d-49d7-ad03-8d036d631e54 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.465890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.466645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.467026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.467402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.475658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.478028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:33.491181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:33.492800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:33.494456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 356/692] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:33.499067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.509345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.563775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6f518-3faf-4c06-bcbe-335ac39e09ac None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.606538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822e355-81c4-4255-a64a-63f18893239c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.627508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.628303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.628597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.628879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.637939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.646819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.648252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.648876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.649156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.650132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.650861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.651666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:33.652218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.655580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:33.671878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:33.672849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:33.674014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:33.674014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:33.674014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:33.674014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:33.674014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 337/693] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:33.682451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.698319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 357/694] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:33.703728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.798886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e7d6-abf0-4c30-b2e8-d2e5d2c00c92 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.806871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.846117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f454e-9921-4c97-aba0-ce2713c0bb9d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:33.852324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.853137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.853599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.854537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.855390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:33.856336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.858578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb80326-3033-409a-8c08-681bd922c02b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:33.876354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 338/695] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:33.878114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d69f-85dd-4d35-b0ae-600214fcf46a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.878555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d69f-85dd-4d35-b0ae-600214fcf46a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.878981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48d69f-85dd-4d35-b0ae-600214fcf46a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.884928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 339/696] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:33.884928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48d69f-85dd-4d35-b0ae-600214fcf46a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:33.890150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:33.890777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:33.891059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:33.891333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:33.966388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:33.986710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:33.988581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.023503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48d69f-85dd-4d35-b0ae-600214fcf46a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.053541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.060726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.061373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.061655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.061930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.069030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.071079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b3e933d7-6e74-4dc2-aa35-e5cdeca0007d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:34.082868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:34.083831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:34.084754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:34.089057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 340/697] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:34.090327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.090619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.090895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.102616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 358/698] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 20:46:34.103812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.109725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:34.110925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:34.191770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 341/699] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:34.191770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.223800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dce90-56b3-46ab-8a43-448c5b052e43 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.239585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.268593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.269929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.270468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.271009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.272029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:34.272561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.274254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.287682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 359/700] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:34.289487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.317284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5e944-f49c-4b74-a7d6-e8df9d1e2675 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.318020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.357181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.358085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.358520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.358950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.370678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.372528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:34.389323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:34.390506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:34.391635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:34.391635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:34.391635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:34.391635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:34.393467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 342/701] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:34.394606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.403424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ebab3-3e71-4683-9e74-a73255943b2a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.439906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.440807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.441091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.441369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.455296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.457088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8c1eef57-b0a4-4ec0-a055-c032311438e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:34.473714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:34.474655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:34.475583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:34.475583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:34.475583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:34.475583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:34.475583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 360/702] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:34.477002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de9016-d64a-4fd6-9725-25db8f1d0b68 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.477002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de9016-d64a-4fd6-9725-25db8f1d0b68 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.477177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de9016-d64a-4fd6-9725-25db8f1d0b68 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.478481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 361/703] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:34.483125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de9016-d64a-4fd6-9725-25db8f1d0b68 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.506347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.516447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ec323-13de-43ee-8bc1-040e2e0bb975 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.553707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.554466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.554751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.555030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.555839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:34.556154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.557585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.561824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.575868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 343/704] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/role_assignments?user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:34.575868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.600007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de9016-d64a-4fd6-9725-25db8f1d0b68 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.653381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.654393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.654742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.655110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.656567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:34.656881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.658858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60170973-b379-4292-91a8-a0d703dbbcb0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.676342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 362/705] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:34.679686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.680128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.680409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.705889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:34.707899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:34.710461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9874b-cc22-47c2-be94-c61fe139a4cf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.750054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.751480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.751788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.752068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.752764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:34.753074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.754453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.769322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 344/706] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:34.770003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.791369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.791681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 363/707] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:34.792513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.878836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:34.913616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43225-a909-4f35-bd58-a737974bfdd8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.919663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72103774-8b37-48a1-a9cc-5137b133d537 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:34.956281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.957194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.957705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.958128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.958959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.961331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.961579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:34.962338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:34.962749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:34.963118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:34.970737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:34.972644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:34.985676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:34.986876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:34.988115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:34.991017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 364/708] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:46:34 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:34.995782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:34.995937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 345/709] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:35.006420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:35.177471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:35.219276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ad65-3023-4181-a4c3-71b249156e30 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.230070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b6f72-12f2-4d35-976a-2a2721b26015 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.256311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.257364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.258444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.258926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.259956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.263544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:35.264158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.269639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.270276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.270559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.270837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.271630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:35.271991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.273469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:35.280029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:35.281345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:35.282256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:35.285746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 365/710] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:35.289058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 346/711] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:35.291173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:35.295034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:35.409433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516bc57-18ee-4a83-942b-aabb348dfbdf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.433761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d04aff-32a1-4e49-8c64-8b7566f743cf None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.448337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.449015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.449559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.449559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.450261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:35.450571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.454899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bebc92-d39c-49f5-a4fa-073733a0d1dc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.462743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 366/712] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:35.465592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245f2d-ff25-42e9-b7ec-240eef0b846a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.465883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245f2d-ff25-42e9-b7ec-240eef0b846a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.466910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245f2d-ff25-42e9-b7ec-240eef0b846a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.471885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 367/713] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:35.472677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b245f2d-ff25-42e9-b7ec-240eef0b846a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:35.495402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.496472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.496983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.498008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.499315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:35.499909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.502426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b424b-a19b-4ff8-8824-b0848dce59fb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.507113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:35.512570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 347/714] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:35 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:35.514132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.514928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.516178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.552697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:35.560698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:35.561971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:35.669518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b245f2d-ff25-42e9-b7ec-240eef0b846a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.671291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 348/715] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:35.696286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:35.715361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.716465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.716943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.717475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.718359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:35.718857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.720814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.727042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 368/716] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:35.840046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c781f9-2a7e-4b4c-af8a-d4956b3fd033 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:35.874642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:35.880611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:35.881276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:35.881559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:35.881834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:35.883089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:35.884506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:35.896281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:35.897316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:35.898738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 349/717] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:35 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:35.905860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:36.024025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e46087-b9e1-4ee3-b49a-946107a49461 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:36.040349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:36.063194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:36.063847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:36.064225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:36.064507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:36.065187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:36.065491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:36.066949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3686a9-b0d2-46bc-9ab5-8c28f2fc98b0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:36.073191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 369/718] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:36.080845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:36.202493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82fce9-b4c0-40f2-a76a-a25d32d92da1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:36.249309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:36.249937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:36.250220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:36.250496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:36.251245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] RBAC: Adding query filter params (type=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:36.251547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:36.252990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548868d-736a-4bf8-966f-14395c2827cf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:36.264442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 350/719] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:37.088285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1a6b-7956-420f-90bf-3ff8e00b74cb None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.088816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1a6b-7956-420f-90bf-3ff8e00b74cb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.088925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f1a6b-7956-420f-90bf-3ff8e00b74cb None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.090491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 370/720] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:37.095360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.095804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.095981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.123852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:37.125039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:37.205743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:37.226791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 351/721] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:37.261327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f1a6b-7956-420f-90bf-3ff8e00b74cb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:37.371855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f1a6b-7956-420f-90bf-3ff8e00b74cb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:37.406219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:37.406871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.407152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.407432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.419088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:37.424173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:37.425114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:37.426371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 371/722] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:37.433070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:37.570489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e14686-d29f-484b-9d0e-4bd6ba0dbcf0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:37.617386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:37.618020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.618302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.618580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.619299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:37.619607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:37.621123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3f7bf-f697-4ded-8aca-ffc5ae41ef91 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:37.635451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 352/723] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:37.641062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:37.683687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:37.706575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676b4-e4c4-4836-9fec-77a746d1e681 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.707207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676b4-e4c4-4836-9fec-77a746d1e681 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.707680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc676b4-e4c4-4836-9fec-77a746d1e681 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.711196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 353/724] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:37.715393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.716117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.716590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.747912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f19c-4cb5-4177-8ecd-2c8a5bcb9572 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:37.758884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:37.760381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:37.783770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:37.783770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:37.784035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:37.784106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:37.795241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:37.796790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:37.819362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:37.820399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:37.821320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:37.821320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:37.821320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:37.821320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:37.822964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 372/725] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:37.827915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:37.854268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:37.888127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 354/726] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 20:46:37.917883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:37.976673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:37.986433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895487f-43d8-4c08-8eb3-42adfc98870d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.026058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.026685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.026967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.027238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.027970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:38.028276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.029647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26669864-82f7-43c3-9a87-a94a31d8ebde None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.042766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 373/727] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:38.044187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaef65-7a5a-4d32-bdc6-4a673377564b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.044480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaef65-7a5a-4d32-bdc6-4a673377564b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.044758 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaef65-7a5a-4d32-bdc6-4a673377564b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.050005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 374/728] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:38.050005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaef65-7a5a-4d32-bdc6-4a673377564b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.071570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c8f24-a84b-406c-87dc-cf8bf95c8f36 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.108730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.109396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.109673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.109943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.121740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-1343a609-f079-49f2-8f60-482b989ca6c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:38.127879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:38.128837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:38.130120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 355/729] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:38.130834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f153-6807-485a-8804-58ac26c94acc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.130834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f153-6807-485a-8804-58ac26c94acc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.131227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795f153-6807-485a-8804-58ac26c94acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.154290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8795f153-6807-485a-8804-58ac26c94acc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:38.155403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8795f153-6807-485a-8804-58ac26c94acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:38.184956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaef65-7a5a-4d32-bdc6-4a673377564b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.194981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.229798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.230744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.231179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.231593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.236133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 356/730] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:38.237191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795f153-6807-485a-8804-58ac26c94acc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.240193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.242422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:38.255610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:38.256632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:38.257674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:38.260544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 375/731] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:38.267782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.282227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.382201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2cc27-1d88-41fc-bdc0-3ca2e93b812e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.420556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.421214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.421495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.421769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.422581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:38.422887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.424850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.444943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 376/732] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:38.446337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.482693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795f153-6807-485a-8804-58ac26c94acc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.518811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.521278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.521907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.522209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.522903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.524280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:38.524280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.525339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046ecfe-b5d7-4e1e-aa21-d7b8c66e1277 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.539274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 357/733] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:38.540599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a341f-1b3a-4aa6-a2ce-79e0a14aeba1 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.540886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a341f-1b3a-4aa6-a2ce-79e0a14aeba1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.541158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a341f-1b3a-4aa6-a2ce-79e0a14aeba1 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.542836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 358/734] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:38.543490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a341f-1b3a-4aa6-a2ce-79e0a14aeba1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.564234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313594a-318b-4d45-b2e7-64fd244a0d82 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.575989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.601723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.602468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.602660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.602941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.612915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:38.618373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:38.619374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 377/735] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:38.620344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.657394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a341f-1b3a-4aa6-a2ce-79e0a14aeba1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.693776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.694307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.694588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.695398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.730589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09100b-e4aa-431e-99b8-a75a4e6aac57 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.758688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.763211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.764707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.769281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:38.769928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.770210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.770485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.782334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:38.784052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:38.797070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-80cf9780-e427-4d8e-8976-4b874e8f4a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:38.800041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:38.801042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:38.801964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:38.801964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:38.801964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:38.801964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:38.805910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 378/736] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:38.807160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:38.807454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:38.807732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:38.826001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:38.827189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:38.877610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 359/737] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 20:46:38.878265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.898180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 379/738] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:38.899028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:38.984670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2104d0-1dfd-484c-b1d9-862459eddafa None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:38.999334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e3da-e6af-4890-8688-37efcafe4c01 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.009706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.014574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.019706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.020352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.020640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.020919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.021633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:39.021943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.023842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.032104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 360/739] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:39.032898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.034041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.034661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.034940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.035225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.035932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:39.036235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.037804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116a5f5-6d1c-4c51-801c-f73c96068532 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.049609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 380/740] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:39.050886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df3e2-da2a-4b66-9888-f98ba395cabc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.051175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df3e2-da2a-4b66-9888-f98ba395cabc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.051454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37df3e2-da2a-4b66-9888-f98ba395cabc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.052704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 381/741] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:39.053383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df3e2-da2a-4b66-9888-f98ba395cabc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.137493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fef6-afde-4e96-b378-348e40b015be None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.155157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37df3e2-da2a-4b66-9888-f98ba395cabc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.172187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.172833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.173112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.173383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.187887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.188938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.189611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.189751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.189918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.190058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.190759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.192187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:39.205794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:39.206781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:39.207704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:39.207704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:39.207704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:39.207704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:39.207704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 361/742] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:39.208526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 382/743] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:46:39 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:39.208605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.208687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.257326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.265110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.330252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a2c6-3365-4006-a1a5-cd6a4803a6e7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.354383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80584f83-916c-4406-982e-a4b00273b023 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.368356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.369345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.369345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.369607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.381999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.384138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.394989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.395642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.395961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.396237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c6756486-725c-4b1f-aad7-e5a30fa4b6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:39.402851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:39.403980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:39.405244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:39.405244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:39.405244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:39.405244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:39.405244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 362/744] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:39.405683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.406016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.406517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.406625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.407222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:39.421015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:39.422105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:39.423088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 383/745] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:39.423724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.426698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:39.428131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:39.511262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 363/746] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 20:46:39.512060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.532444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.545897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.551317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625679d-3292-49e5-834f-cb88f8f2532e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.586556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.587293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.587573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.587872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.588600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:39.588905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.590394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.607663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 384/747] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:39.607663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.629638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce0019-a118-409d-99b2-73cc3c475975 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.665298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.666289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.666779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.667238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.668141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:39.668628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.670194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.682450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 364/748] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:39.683599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.725475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a0f7f-7b83-4682-bc32-e6de3524ef8f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.762911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.763454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.763737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.764070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.764867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:39.765609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.767407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.779309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.786610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 385/749] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:39.787243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.791655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:39.796432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbe50c-80bd-4c90-8e58-90a1ae486ed5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.833705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.834340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.834626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.835202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.835967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.837349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.853326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 365/750] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:46:39 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:39.854048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:39.921747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c280b-9091-4644-bb09-e8910f118aa6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:39.973118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:39.974774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:39.975297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:39.976150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:39.987774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:39.989732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:39.990082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73135d29-b0fe-43b1-af9c-cb452e7c0707 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:40.006906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:40.008528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:40.009456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:40.012336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 386/751] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:40.013529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.034745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.035406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.035688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.036021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.045789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.047373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:40.060771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:40.062054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 366/752] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:40.063043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.079513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.090134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.143828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e1596-1ce6-40b0-8520-9b88ef52d724 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.179636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.180658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.181150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.181631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.190950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904fd0-bb7c-4665-9daa-d50cbacad7d5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.229369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.230016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.230347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.230556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.231315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:40.231625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.233224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.247393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 367/753] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:40.248481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.258778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.260954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.321736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.323052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.363190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6bd6e-cf3d-4749-898d-89cf2878525b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.370506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 387/754] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:46:40.371738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.403906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.404535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.404820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.405099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.405899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:40.406210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.407655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.427418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 368/755] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:40.428326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.491003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecddc1-ad57-4ec0-a76d-6f0ef3dc0fcf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.527457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.527911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.528235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.528527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.529354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:40.529672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.531157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.544086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 388/756] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/role_assignments?user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:40.545259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.563776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76279ec7-42ff-4a22-b29c-889af81d5acc None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.600683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.607803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.609254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.610193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.611166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.611847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.624998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.627646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:40.645655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:40.646657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:40.647579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:40.647579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:40.647579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:40.647579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:40.650821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 369/757] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:40.656914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.761557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bee2c-ac73-49a3-96a8-b8ee7a9aad12 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.801823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.802467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.802744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.803016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.815028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.816512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.824252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88def9-932b-4a06-a701-f4bd75a20b67 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:40.831494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:40.832433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:40.833734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:40.833734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:40.833734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:40.833734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:40.833734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 389/758] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:40.838981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.874020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:40.874636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:40.874918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:40.875246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:40.876025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:40.876337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:40.877725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:40.907266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 370/759] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:40.913528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:40.950864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:40.978743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ff0d6-af4f-45f1-baef-018a463c8cbe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:40.992804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:41.025352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.027175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.028347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.029720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.030431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:41.030744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.032154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.055321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 390/760] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:41.060620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.083794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ea6a-3a63-44c2-87d8-99a5062ed5ca None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.123900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.124902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.125199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.125476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.134502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.136036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:41.150707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:41.151699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:41.153271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 371/761] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:41.159448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.242503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669672cb-0d6b-4e86-a691-e6887f65f397 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.285200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.286353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.286501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.286814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.297393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:41.304361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.309538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:41.338654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:41.339639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:41.340585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 391/762] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:41.352032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.363466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:41.369321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1919-ccb8-4ed3-97be-8b5da28730f4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.411429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.412025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.412310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.412586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.414052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:41.414370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.416391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a9867-04e8-4413-933f-966811510c09 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.431628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 372/763] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:41.437727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7b3a-b433-48ce-ac93-d2b87a426d19 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.438020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7b3a-b433-48ce-ac93-d2b87a426d19 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.438293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7b3a-b433-48ce-ac93-d2b87a426d19 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.443784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 373/764] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:41.443784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef7b3a-b433-48ce-ac93-d2b87a426d19 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.504549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899a18e-d808-49d1-a6b1-8d15ed535418 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.555652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.557078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.557873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.558497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.559721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:41.560736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.562930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06755281-aa63-4d5a-9954-de1d5ff5bf1f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.580712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 392/765] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:41.582174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.582463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.582737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.583964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef7b3a-b433-48ce-ac93-d2b87a426d19 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.601374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:41.602504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:41.630378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.632076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.633102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.633836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.635396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a720e28d18904eacaf37c162a398c288) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:41.636050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.637814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.644962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 374/766] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/role_assignments?user.id=a720e28d18904eacaf37c162a398c288&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:41.646238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.693328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:41.706753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:41.755773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 393/767] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:41.776814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:41.847530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a58221-fb14-46fa-9115-9c2a50fe7c3a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.897016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.897698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.897977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.898248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.901356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=fff966e741314bb8b510713bff46a08c, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.902796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.911782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f30b-1ef3-47d2-a2e1-193b6a95f925 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:41.924772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 375/768] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:41 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:41.956515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:41.957619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:41.958142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:41.958599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:41.959569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:41.961393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b3dd6945-83d2-442a-88a4-f0b39dbf5cac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:41.972268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:41.973315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:41.974206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:41.977605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 394/769] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:41.984476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.103942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.129039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4902d6-4f44-41e8-8826-98748cc3786f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.133974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6c1a-5aba-4a15-9bad-9a385d8f7ec9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.134270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6c1a-5aba-4a15-9bad-9a385d8f7ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.134553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa6c1a-5aba-4a15-9bad-9a385d8f7ec9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.136215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 395/770] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:42.144637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.144927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.145211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.173739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:42.175191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:42.188702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.189357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.189638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.189910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.190606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:42.190912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.192346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.205169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 376/771] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:42.210483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.261150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.288833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 396/772] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:42.310765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.369525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930da9e-03e8-41d8-a48f-a1070e3a404a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.459379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4920-8e13-4bed-905f-51fe88553854 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.481011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.481749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.482096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.482434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.483184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:42.483552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.485020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.497715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.498587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.498944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.499283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] PATH_INFO: `/v3/services/network` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.500014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.500813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 377/773] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:42.501531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.506864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:42.511536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:42.512800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:42.513878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:42.516743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 397/774] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:42.524730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.542329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.612150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.698920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd14a1-3782-49fe-85ab-717bd6f269c2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.703553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f099d-e1b4-4905-b670-69368f6bae42 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.760548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.761199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.761485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.761760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.762535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] RBAC: Adding query filter params (interface=public, service_id=1e5a58e713854be59f9aa5690cf346b9, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:42.762849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.764282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.778368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.778988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.779268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.779540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.780242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:42.780550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.781981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.789200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 378/775] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/endpoints?service_id=1e5a58e713854be59f9aa5690cf346b9&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:42.791312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 398/776] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:42.796594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.800196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:42.909156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f84b7-c529-4c29-953c-ee7a41d601c6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.919115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.935954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:42.962538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:42.963179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:42.963459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:42.963732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:42.964451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] RBAC: Adding query filter params (type=network) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:42.964754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:42.968106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:42.980319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362242a-407d-4d95-8a70-fdfd11d5db71 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:42.982752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 399/777] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:42.983863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:43.033274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.033900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.034183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.034513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.035221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:43.037232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac254a8-c8e4-4856-81a4-5313e4df9a06 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:43.051916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 379/778] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:43.053589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e16b-6520-4a40-949c-f9b3264b6723 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.059792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e16b-6520-4a40-949c-f9b3264b6723 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.059792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e16b-6520-4a40-949c-f9b3264b6723 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.059792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 380/779] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:43.068639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.068954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.069187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.089559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:43.090847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:43.172605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d2c8e-2666-48e1-898e-08e7dedcc552 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:43.175712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 381/780] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:43.218886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:43.224372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.225018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.225302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.225578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.226889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] RBAC: Adding query filter params (interface=public, service_id=22d81279ddf344c9a984e61499ad6f86, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:43.227201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:43.228643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:43.255782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 400/781] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:46:42 2022] GET /identity/v3/endpoints?service_id=22d81279ddf344c9a984e61499ad6f86&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:43.267198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:43.315113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:43.326267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:43.390733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2decde-3afd-4520-bf30-c91ff9cf8c90 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:43.440285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231363-b3a1-4916-b613-d2e1f11b2d24 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:43.481583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.482230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.482515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.482793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.483470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:43.484905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:43.488480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.489146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.489428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.489703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.501114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 401/782] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:46:43 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:43.515840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:43.521148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:43.523465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:43.525491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 382/783] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:43.533401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:43.655212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:43.658698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f514970-f570-4ebd-b233-c4f6d8d5a7d8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:43.699279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.700215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.700488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.701296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:43.701607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:43.702976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:43.715659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 402/784] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:43.721528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:43.851612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4c07-98a9-47a3-bc70-c4c3e7e905b2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:43.886686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:43.900334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:43.901095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:43.901361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:43.901637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:43.923698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:43.925190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-29471784-3c99-4ec1-a008-e0f5797cd200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:43.945376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:43.947475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:43.949610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:43.949610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:43.949610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:43.949610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:43.949610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 383/785] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:43.955825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.073528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b512e4-82ce-43c8-8204-61bd1fe77641 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.073860 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b512e4-82ce-43c8-8204-61bd1fe77641 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.074086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b512e4-82ce-43c8-8204-61bd1fe77641 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.075559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 384/786] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:44.083779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.083779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.083779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.114067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb56396-b2d9-4332-969a-72cc2ee9bd36 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.116412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:44.117604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:44.162716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.163381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.163664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.163965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.164672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:44.164979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:44.166355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:44.194865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 403/787] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:44.201203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.234539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 385/788] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:44.247287 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:44.279069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.395309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ac3c7-6012-4f72-b71a-1edb3bc1ac83 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.414953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03d0a8-fdaa-47b6-9deb-c62d13c2acd5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.426614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:44.467657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.468356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.468636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.468914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.475803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.476368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.476649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.476927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.491777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:44.491777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:44.496320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:44.501721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:44.502649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:44.503580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:44.504271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:44.505129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:44.506181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 404/789] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:44.509033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 386/790] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:44.511053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.516710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.623957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1f0b-2bf0-40ef-8842-8619120caec1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.660939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.661559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.661844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.662120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.662847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:44.663821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:44.665209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50758d8f-a583-42e3-a469-bb1c6ef3ffde None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:44.671145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:44.676909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 387/791] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:44.679792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c309-5a01-4075-a6a1-06eda96886c6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.683429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c309-5a01-4075-a6a1-06eda96886c6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.683728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787c309-5a01-4075-a6a1-06eda96886c6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.685478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 388/792] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:44.686115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787c309-5a01-4075-a6a1-06eda96886c6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.692676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ddda1-7357-4392-ac92-884620c85ae5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.720880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:44.739978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.741201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.742208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.742925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.744416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:44.745186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:44.747450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce2011-8104-4ea8-94a1-b4beb768af12 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:44.776003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 405/793] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:44.777204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.779281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.779566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.803027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:44.805877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:44.809185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787c309-5a01-4075-a6a1-06eda96886c6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:44.850020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:44.851228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:44.851515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:44.851829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:44.864228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:44.865881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:44.882959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:44.883960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:44.884876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:44.884876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:44.884876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:44.884876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:44.888754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 389/794] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:44.889731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.898305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 406/795] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:44.899568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:44.987437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:44.995458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.009258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd61e11-8735-44d7-8af7-890e21987ad1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.041145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d71a31-13a6-4bc3-baab-0826a4c2c660 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.046490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.047397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.047872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.048298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.060519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.062216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:45.081125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.082177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.083105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:45.083105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:45.083105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.083105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.083334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.084222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.084566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.085423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.086200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:45.086595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 390/796] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.087571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.091435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.093978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.111785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 407/797] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:45.111785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.206670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5faf5c-633e-41e0-8982-be087e02235c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.230007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c078e-8f79-4a3a-8556-1c1adfd4138f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.242189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.242688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.243058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.243402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.246344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.255602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:45.261745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.262740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:45.263650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.268462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 391/798] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.268962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.270260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.275898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.276860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.277295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.277753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.278622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:45.279085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.280677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.294732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 408/799] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:45.295790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.385725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a28e-097f-4bf2-bfd9-a57a87baf565 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.406400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e67ff-96ca-4a46-8f56-2fc275f34ac1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.424079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.424748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.425113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.425387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.434894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.436783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.448684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.449311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:45.449584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.450499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:45.451454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.452488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.452488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.452488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:45.452679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 392/800] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.452679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.455273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.456766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaad2c-7e49-4c3c-8b52-d279dfca188a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.466368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 409/801] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:45.469083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fdd45-769a-4e22-ab92-eb74934c9ad1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.470351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fdd45-769a-4e22-ab92-eb74934c9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.470979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fdd45-769a-4e22-ab92-eb74934c9ad1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.472451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 410/802] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:45.473426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fdd45-769a-4e22-ab92-eb74934c9ad1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.521016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.537887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.569159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647b653-27e0-4e88-8a46-c87824f08102 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.590712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fdd45-769a-4e22-ab92-eb74934c9ad1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.603851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.604500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.604782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.605060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.611812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.613275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:45.625408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.626438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 393/803] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.627350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.632467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.633093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.633371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.633644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.634444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:45.634749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.636202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf05a-3b5b-46d6-b10c-0d74b1ae7b62 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.653940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 411/804] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:45.655203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.655476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.655770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.673721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:45.674898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:45.742462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1c95c-9cc7-46de-a154-3a799f472acd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.745084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 412/805] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:45.745930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.773471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.792403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:45.793269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.793840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.794109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.794388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.805978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.807441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:45.822492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.823407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.824359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:45.824359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:45.824359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.824359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.824359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 394/806] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.824646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.862173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecb6ab-a690-4b96-82d4-7060e6c91108 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.896291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.896909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.897199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.897498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.898250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:45.898558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.900032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.911492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 413/807] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:45.912322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:45.927111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b47c6-956e-4adf-a433-c99464fc3699 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:45.960550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:45.961190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:45.961474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:45.961751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:45.972114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:45.973568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:45.987652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:45.988638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 395/808] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:45.989633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.011704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.013319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.016421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01911306-74fb-451c-ba47-909cc64e3c0a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.050492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.051060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.051345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.051623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.052290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.053666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d5d6025b-cf64-4777-bc27-2ab81e2b26c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:46.062400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:46.063520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:46.064532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 414/809] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:46.065613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc408e2-4518-4687-96f7-76ebe2babc34 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.065900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc408e2-4518-4687-96f7-76ebe2babc34 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.066185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc408e2-4518-4687-96f7-76ebe2babc34 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.067426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 415/810] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:46.068132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc408e2-4518-4687-96f7-76ebe2babc34 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.095642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef339ac-031c-4c38-a158-8acaabace37f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.129215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.129836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.130123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.130403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.131096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.131402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.133375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.144952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 396/811] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.145747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.169651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc408e2-4518-4687-96f7-76ebe2babc34 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.203351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.204050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.204336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.204621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/dc7e41de613b48f9a9cb7e0a5ceb0aa6/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.206607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=dc7e41de613b48f9a9cb7e0a5ceb0aa6, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.208047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.222096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 416/812] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:46 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/dc7e41de613b48f9a9cb7e0a5ceb0aa6/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:46.222899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.236161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.262395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bdd6-819b-4fcc-9cca-d8047d04f966 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.263494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.304813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.305371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.305707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.306003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.306774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.307087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.308552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d112e4-5d22-499e-a247-49c6468f1384 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.327500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 397/813] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.328878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.329177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.329459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.348973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87be8b-c06a-47a0-89ce-a03e974aad65 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.350718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:46.352101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:46.391847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.392477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.392762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.393036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.393720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.394026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.395400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.401515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 417/814] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.401990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.435367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 398/815] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:46.435367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.505109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.518252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99ae59-1ff6-41a6-a70c-4f366514a511 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.529630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.556415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.557350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.557906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.558188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.562341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efbbe7-987a-4147-accc-b8a49b02f603 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.568935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.570948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:46.582539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:46.583517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 418/816] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:46.584847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.602925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.603566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.603876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.604149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.610839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.612266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:46.624906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:46.625839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:46.626772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:46.630785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 399/817] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:46.631638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.696632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76ff1f-d19d-410e-983c-ace7cad6bf00 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.732009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.732631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.732915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.733197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.733863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.734168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.735530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.736413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027922-3862-4644-994e-7b5c2e98b59c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.742048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 419/818] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.745022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.761632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.769809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:46.776763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.777398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.777680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.777951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] PATH_INFO: `/v3/services/network` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.778579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.779977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:46.789340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:46.790427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:46.791306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 400/819] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:46.792186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.857628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133c9d0-d23d-46de-b092-b0ae29aa3d9d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.893320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.893938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.894220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.894492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.895279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.895583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.897033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.898680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d010cec-932e-42bb-aac4-84536c6dba83 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:46.919312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 420/820] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.919312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.940041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:46.940664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:46.940945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:46.941226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:46.941976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:46.942284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:46.943734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:46.955893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 401/821] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:46.956704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:46.990804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.017004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.021987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026bc1-d457-429e-ab82-8c38eea060a0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.057222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.058149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.058572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.059072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.059958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.061683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.064461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3a3da-5972-4d03-9e37-94f55c6c3e08 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.084668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 421/822] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:46:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:47.085973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.116926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.117961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.118601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.119204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.120205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] RBAC: Adding query filter params (name=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:47.120831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.122724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.129442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 402/823] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:47.130685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.230550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc09a-2cd6-44a2-b03d-099ceed03415 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.258333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ebfcd-a0bc-487d-a845-dbbfddb5ea9f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.274935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.276866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.286978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.287493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.287855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.288687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.304953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.305633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.306161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.306161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a720e28d18904eacaf37c162a398c288/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.326682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=a720e28d18904eacaf37c162a398c288, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.329019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.348817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 403/824] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:46:47 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a720e28d18904eacaf37c162a398c288/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:46:47.350152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.402469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.405493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.555578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8d0a-3b8a-44f1-af60-3ffb49d8da60 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.575233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 422/825] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:46:47.582906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.611258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.611919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.612206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.612480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.613166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] RBAC: Adding query filter params (type=network) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:47.613474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.614864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.627157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 404/826] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:46:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:47.630461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.633680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.688129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:47.772738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c5a2-9823-49c5-a538-bb77061b5f2c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.834313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba3b01-2a7c-4ddd-805c-6389f1e3115e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:47.845375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.846038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.846325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.846599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.865012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.867076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:47.884732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:47.885735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:47.886658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:47.886658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:47.886658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:47.886658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:47.886658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 423/827] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:47.892652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:47.917188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:47.917829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:47.918115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:47.918392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:47.921537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:47.924022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:47.961284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 405/828] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:46:47 2022] POST /identity/v3/endpoints => generated 337 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:48.016337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:48.042708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b856d9-bc78-4aa5-af47-1e16c9b9697c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.093537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.094181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.094459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.094736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.095437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:48.095763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:48.097141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:48.116688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 424/829] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:48.121261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.244097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:48.263481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6eb5-6dce-4fbe-9fc8-7e687c16b02b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.299993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.300654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.300938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.301220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.308978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:48.310447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-f5e91739-3c27-4531-9e75-d71422d3ee11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:48.322439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:48.323358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:48.324278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 406/830] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:48.329815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.376055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c77c-3d16-43ce-a333-bb2e006798f2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.376362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c77c-3d16-43ce-a333-bb2e006798f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.376626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468c77c-3d16-43ce-a333-bb2e006798f2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.378111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 407/831] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:48.383277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.383835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.384318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.410739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:48.412317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:48.448161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8cb28-f797-44e8-9b56-0507b118fd8f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.503008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.504010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.504569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.505112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.506092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:48.506637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:48.508904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:48.511318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:48.511513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 408/832] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:48.523551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 425/833] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:48.529113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.547291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.621547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:48.650058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093280-6dbf-4ba1-a5a0-97f7c8c16c6c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.669688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaf5b9-718e-418e-a314-8aaa03c75dc5 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.685396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.685791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.686076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.686353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.687178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:48.687450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:48.688920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:48.695658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 409/834] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:48.708990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.710556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.710992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.711419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.724928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:48.730912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:48.732109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:46:48.732967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:48.739907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 426/835] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:48.742822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.858584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc64124-614f-4add-a07b-80310f3020a1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:48.893081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:48.893706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:48.893985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:48.894262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:48.894974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:48.895280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:48.896696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:48.902819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:48.908082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 410/836] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:48.914132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:48.974363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.022858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506ba3d-80fc-4092-889a-59c6a10436d6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.058193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.058848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.059133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.059410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.071137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.072638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:49.087291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:49.088249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:49.089187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:49.089187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:49.089187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:49.089187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:49.093167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 427/837] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:49.094504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.203215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e5ce-55fb-4d73-adc5-5c19084c904c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.239958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.241022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.241519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.242017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.242909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:49.243433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.245045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abf82-367f-409a-9849-15ea32be7aec None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.258171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 411/838] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:49.263847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.362346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777557d-ac13-4b26-abcb-0b3b95728b2d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.362670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777557d-ac13-4b26-abcb-0b3b95728b2d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.362907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777557d-ac13-4b26-abcb-0b3b95728b2d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.364544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 412/839] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:49.369278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.369567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.369842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.372980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241938e3-0b06-4e16-891a-d71d4199bfa4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.383955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.388547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:49.389763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:49.411290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.411977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.412261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.412533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.420558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.422004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:49.434085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:49.435159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 20:46:49.436260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:49.439989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 428/840] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:49.441223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.463194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.481327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 413/841] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:49.497847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.574743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d322c-0e3a-433a-9d3e-d17e043f8439 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.616951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.617577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.617861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.618136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.618969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:49.619281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.620766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1b139-ad57-4fb1-9dc2-161d4d976888 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.627211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4c1f-6549-4cdf-a150-a811691a63f5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.639658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 429/842] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:49.641189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682a999-b131-427e-99c6-d5d3810a65f1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.641536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682a999-b131-427e-99c6-d5d3810a65f1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.641882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682a999-b131-427e-99c6-d5d3810a65f1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.643784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 430/843] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:49.645039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682a999-b131-427e-99c6-d5d3810a65f1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.671203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.676204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.677311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.678027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.678027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.678697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.680389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-24f17c16-9949-48aa-97a6-0697f3e985d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:49.690661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:49.691654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:49.692742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:49.695885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 414/844] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:49.697188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.697775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.698060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.717103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:49.718343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:49.753638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682a999-b131-427e-99c6-d5d3810a65f1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.769719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.788656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 415/845] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:49.790574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.791445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.791958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.792404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.792529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.869462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.870937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.896795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:49.902481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47f198-7e95-4360-ae51-9930769725dd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:49.940076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:49.940707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:49.940990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:49.941266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:49.941950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:49.942257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:49.943646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:49.949325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 416/846] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:49.950393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:49.984915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 431/847] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 20:46:49.985702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.007738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.060224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d30433-9add-43ab-9e8b-9e9441c9d50d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.090999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca3f5-6e0e-4782-9d93-69b8b6c8236e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.096355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.097004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.097287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.097565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.109622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:50.114589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:50.115588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 417/848] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:50.116583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.122677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.137258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89817b-4389-4e58-8668-643def373595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.137871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89817b-4389-4e58-8668-643def373595 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.138150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89817b-4389-4e58-8668-643def373595 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.138419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89817b-4389-4e58-8668-643def373595 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.139115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89817b-4389-4e58-8668-643def373595 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:50.139421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89817b-4389-4e58-8668-643def373595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.140815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89817b-4389-4e58-8668-643def373595 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.145267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 432/849] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:50.146019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89817b-4389-4e58-8668-643def373595 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.263015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89817b-4389-4e58-8668-643def373595 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.269344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06628859-e207-4a1a-a0ae-9eab2afd97cd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.285476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.304132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.304766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.305042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.305314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.306036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:50.306341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.307820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.318262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 433/850] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:50.323877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.326892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.327781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.329113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.329546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.342571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.344306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:50.362739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:50.363720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:50.364797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:50.364797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:50.364797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:50.364797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:50.364797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 418/851] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:50.370923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.383902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.440372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124cfed-2a71-4a1e-95be-fd366a5f7666 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.480958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.481869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.482301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.482723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.483512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec054f6e-4568-4412-9d79-6ace55e641d9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.495056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.497657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:50.517666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:50.518620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:50.519549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:50.519549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:50.519549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:50.519549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:50.523628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 434/852] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:50.524858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.536095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.537694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.538191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.538671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.540098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:50.541030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.542943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.560186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 419/853] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:50.565346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.597787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.645148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984309-67ca-45f8-be49-871ccd9ca800 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.647238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.684807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.686203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.686684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.687178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.688180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:50.688683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.690312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.703213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 435/854] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:50.705871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a68585-fc64-428a-8277-3651dd2ca361 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.709342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.750466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.751120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.751403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.751790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.758905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.760413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:50.772627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:50.773581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:50.774494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:50.778652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 420/855] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:50.779817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.834934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31919-2d61-4d33-a4c3-954ad0e49842 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.872132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.872779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.873061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.873338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.882237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.883794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.889459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d9bec9c2-179f-4b69-8350-614cb2584601 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:50.895820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:50.896781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:50.897788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 436/856] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:50.898400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a132-f572-4f6a-b06d-75b52976e94e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.899407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a132-f572-4f6a-b06d-75b52976e94e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.899407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0a132-f572-4f6a-b06d-75b52976e94e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.900459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 437/857] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:50.902796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0a132-f572-4f6a-b06d-75b52976e94e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:50.917063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9c6-33e4-435a-a244-09b10740f3d9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:50.929796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:50.954000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:50.954634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.954919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.955200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.956021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:50.956333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:50.957783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c5145-9253-4e0c-8269-9c615bf54d70 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:50.974976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 421/858] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:50.974976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:50.974976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:50.974976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:50.990609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:50.991913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:51.017936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0a132-f572-4f6a-b06d-75b52976e94e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.058663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.059349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.059688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.059986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.060717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:51.061116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.062423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.071801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 422/859] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:51.071801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.091993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 438/860] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:51.092814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.152641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.175793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.187794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251679-1c4a-4366-bd4f-ba120a77271b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.194643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65831717-f20e-46af-9210-600c2cef7222 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.224416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.225445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.225909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.226365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.227324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:51.227928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.228035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.228703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.228979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.229253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.229876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.230377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.231223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.236938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 423/861] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/role_assignments?user.id=dc7e41de613b48f9a9cb7e0a5ceb0aa6&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:51.237899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:51.239985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:51.241463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:51.242338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:51.246682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 439/862] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:51.247595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.378325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d214-73e8-4d12-a748-8cb0dc463e90 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.394676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c11c1-d5bb-41a3-bbb5-737c2aa58112 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.423632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.424291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.424572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.424846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.428016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.446561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.447187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.447473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.447777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.448489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:51.448867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.450347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.458639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 440/863] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:51.465288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.481666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.517875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.519682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.611274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093f5db-338b-4e47-aa7d-f2ea505e4350 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.637955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 424/864] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:46:51.639249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.657311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.658344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.658897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.660079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.661198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:51.662050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.664194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.676981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 441/865] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:51.679045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.763496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c27de-c0ad-4336-a93b-bfdbc6b04dfe None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.802706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.803566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.803993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.804375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.816252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:51.817919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:51.835302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:51.836478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:51.837606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:51.837606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:51.837606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:51.837606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:51.838763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 425/866] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:51.844710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:51.928807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:51.961329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fe84-9929-4257-afe2-9abfae7674f3 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:51.996266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:51.997037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:51.997427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:51.997808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:51.998608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:51.999038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:52.000540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:52.013986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 442/867] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:52.019411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:52.110682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:52.127540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ba650-ce6b-4a5e-802b-652f68fbfbfb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:52.163399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:52.164250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.164688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.165087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.172183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:52.173749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2b1e8b6a-e1c8-4fdd-85be-b26f5bd4a1be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:52.186358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:52.187441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:52.188696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:52.190300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 426/868] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:52.196051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:52.301052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255580a-ff08-40da-aa5e-65d9bbbffe06 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:52.319979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6dd6d-3079-4913-b548-c35fec55a7d3 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.320459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6dd6d-3079-4913-b548-c35fec55a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.320845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6dd6d-3079-4913-b548-c35fec55a7d3 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.322560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 427/869] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:52.328381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.328673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.328952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.341367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:52.347423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:52.348074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.348354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.348624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.349367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:52.349671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:52.351620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:52.352934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:52.355114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:52.364820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 443/870] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:52.373296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:52.439950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 428/871] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:52.455656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:52.500261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e498ca0-4be6-4fc8-8bda-cf4ac28a1479 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:52.546239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:52.554538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:52.555313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.555585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.555892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.556827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a720e28d18904eacaf37c162a398c288) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:52.557134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:52.558580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfbf43-d9d6-4b53-87f2-c76b5a24ca0d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:52.566722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 444/872] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:52 2022] GET /identity/v3/role_assignments?user.id=a720e28d18904eacaf37c162a398c288&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:52.581096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131577-d29f-4c0c-9ba3-471f27245512 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:52.628367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:52.629397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:52.629830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:52.630316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:52.631194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:52.632923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83b19a-7d59-400c-a3d9-b630f2c5aa57 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:52.656308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 429/873] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:46:52 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:53.346652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5caa-2f94-43cf-885e-1a5ddafd7a5a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.347215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5caa-2f94-43cf-885e-1a5ddafd7a5a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.347215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5caa-2f94-43cf-885e-1a5ddafd7a5a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.348819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 445/874] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:53.354746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.355142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.355307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.373503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:53.374698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:53.452718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 430/875] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:53.474930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5caa-2f94-43cf-885e-1a5ddafd7a5a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:53.535823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:53.581446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5caa-2f94-43cf-885e-1a5ddafd7a5a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:53.616469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:53.617034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.617315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.617594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.618279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:53.619651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:53.628640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:53.629672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:53.631115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 446/876] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:53.636450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:53.700880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:53.743582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760edaef-9c9d-4c6b-b2b6-7c7c9d94e263 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:53.781030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:53.782039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.782795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.783274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.784191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:53.784748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:53.786490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6edee-8356-41a7-9878-21d975e9aa0e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:53.792880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 431/877] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:46:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:53.798254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:53.827616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4a26-54ba-4a57-957d-8a67a6f01041 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.828253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4a26-54ba-4a57-957d-8a67a6f01041 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.828733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c4a26-54ba-4a57-957d-8a67a6f01041 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.830510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 432/878] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:53.836352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.836842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.837410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.857269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:53.858875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:53.911232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419080f-8c8b-4b86-859a-a169df0b945c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:53.935131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:53.938032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 433/879] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:53.955423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:53.956265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:53.956611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:53.957010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:53.957756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:53.958204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:53.959706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9956f-7f4b-49c2-b702-8f4cc08d1fc2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:53.962577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:53.964845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 447/880] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:46:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:54.027065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:54.075806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35561ef-508a-4f19-a01a-376b6c07faa4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:54.114663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:54.115303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.115632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.115991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.116704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:54.118159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772756f6-1ba3-4262-9d56-d47e84742441 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:54.134262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 434/881] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:46:53 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:46:54.679264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ec93-77b4-4802-b86c-4b9f6db2e737 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.679805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ec93-77b4-4802-b86c-4b9f6db2e737 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.679920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ec93-77b4-4802-b86c-4b9f6db2e737 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.681464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 448/882] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:54.686731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4150c3-6ff3-4e3d-a28e-05525ba25db1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.687130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4150c3-6ff3-4e3d-a28e-05525ba25db1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.687300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4150c3-6ff3-4e3d-a28e-05525ba25db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.706158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cf4150c3-6ff3-4e3d-a28e-05525ba25db1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:54.707370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf4150c3-6ff3-4e3d-a28e-05525ba25db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:54.785279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 435/883] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:54.816544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ec93-77b4-4802-b86c-4b9f6db2e737 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:54.842867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c724-dea3-4e8b-86cd-c4126c6db1e2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.843156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c724-dea3-4e8b-86cd-c4126c6db1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.843550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701c724-dea3-4e8b-86cd-c4126c6db1e2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.845350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 436/884] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:54.850827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.851150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.851491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.870798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:54.872406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:54.923690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ec93-77b4-4802-b86c-4b9f6db2e737 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:54.923927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:54.960581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:54.961244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:54.961756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:54.962040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:54.971768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 437/885] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:54.978535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:54.983458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:54.984503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:54.985367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 449/886] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:46:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:54.991460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:54.993397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.052265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.105376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6177-7698-401b-9d7c-3d05112c451c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.111389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf903-c2b3-4b1d-82c2-ffe106e29b9d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.144949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.146011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.146609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.147107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.148091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:55.148602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.150498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.155296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.155968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.156257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.156528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.157961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.159629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.161396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 438/887] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:46:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:55.167575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:55.174283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:55.175298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:55.176192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:55.184456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 450/888] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:55.185792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.210264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.307261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15cdb-80b2-47ba-a9ef-0804e76d3a3e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.313552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b211e-5a92-4a7c-9649-0412a45bfbd8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.325314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.354991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.356050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.356374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.356861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.356970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.357257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.357531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.357856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.358205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:55.358510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.359923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.369588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 451/889] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:55.370899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.374805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.376326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:55.391449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:55.392407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:55.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:55.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:55.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:55.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:55.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 439/890] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:55.398099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.486655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801444-dc47-402b-a660-11a6fd7fe89a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.517791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.527503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.528538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.529263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.529728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.531283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:55.531902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.534654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.536612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a1d6-fc6e-4a83-89a0-4b5030117051 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.547320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 452/891] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:55.548484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.592137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.592742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.593095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.593460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.594296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:55.594722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.596166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.601562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.614590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 440/892] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:55.615793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.694252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86760cb-dbb4-48f0-addc-6fae769ecfaf None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.730268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.731010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.731361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.731707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.732581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] RBAC: Adding query filter params (interface=public, service_id=e03d9a2cfc6a4028993c78318b609fe6, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:55.732965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.734506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.739123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc0f81-7fa3-4c71-872c-bc372f620de7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.744696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 453/893] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/endpoints?service_id=e03d9a2cfc6a4028993c78318b609fe6&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:55.745679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.783945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.784993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.785494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.785986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.795019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.797119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:46:55.810528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:55.811529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:46:55.812542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:55.815133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 441/894] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:55.821371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:55.831875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.863112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:55.866396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ebad0-bfc1-4514-b0e7-4c35eb785140 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:55.904161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:55.904784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:55.905164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:55.905539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:55.906295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:55.908156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:55.923779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 454/895] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:46:55.965092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fa513-730f-4e9e-84b8-43364a5b8526 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.008934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.009960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.010482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.010966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.012035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:56.012581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.014274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca8afd-fd1a-4239-9134-f85446a71435 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.035787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 442/896] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:56.047597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.141980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc73-5c10-48f8-bc0c-ebc2cf0920df None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.142170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc73-5c10-48f8-bc0c-ebc2cf0920df None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.142455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fdc73-5c10-48f8-bc0c-ebc2cf0920df None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.143853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 443/897] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:56.149280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05b884-e2bb-4895-ab8d-79f45a369753 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.149607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05b884-e2bb-4895-ab8d-79f45a369753 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.149880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05b884-e2bb-4895-ab8d-79f45a369753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.164302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba0d8-aa72-4d15-bdf9-e0c61105bffa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.169370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9b05b884-e2bb-4895-ab8d-79f45a369753 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:56.170558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9b05b884-e2bb-4895-ab8d-79f45a369753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:56.202861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.204002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.204418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.204821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.235351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.238570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.251769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 444/898] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:56.251769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80128dfe-5e27-4a46-ad2e-b97523e38838 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.251769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80128dfe-5e27-4a46-ad2e-b97523e38838 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.251769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80128dfe-5e27-4a46-ad2e-b97523e38838 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.251769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 445/899] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:56.254372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.254658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.255464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.278267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:56.279455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:56.283688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.285158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.352353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 446/900] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:56.353548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.405794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 455/901] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:46:56.406954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.469562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c656a26-87d2-41b5-91a9-8502308324ba None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.480876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.497406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.511035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.511664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.511978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.512253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.512953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.514336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.520580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada8b34-bb2a-40ab-b746-91721bb377de None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.539847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 447/902] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:46:56 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:46:56.540867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.569961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.570765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.571053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.571328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.572102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.573656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:56.583938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:56.585555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:56.586394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:56.591203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 456/903] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:56.592261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.693149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364041e-653e-4ae6-ad55-db636bb4a95b None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.730887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff6003-038e-4200-a3f8-934908a4db19 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.736674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.736944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.737227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.737506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.750526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.752055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.763736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:46:56.767789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:56.768856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:56.769827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:46:56.769827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:46:56.769827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:46:56.769827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:56.769827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 448/904] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:56.774926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.780882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.781731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.782198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.782938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.783837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:56.784328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.786342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.793912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 457/905] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:56.799166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.820135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:56.889490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5e365-b0ab-46be-ac87-714c640961a4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.907997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784d53-69a3-42af-a432-b10bad47a55c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:56.927234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.927915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.928738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.929017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.929714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:56.930019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.931406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.947899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 449/906] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:56.950657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:56.951292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:56.951601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:56.951915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:56.952608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:56.952910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:56.954313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:56.956634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:56.966227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 458/907] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:46:56.969354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:57.039854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:57.082149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:57.091852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655444cf-7320-49bc-853a-35807b7cc45f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:57.096219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aef0e-a134-401c-b52b-c8935cfc30f7 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:57.129048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:57.129701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:57.129985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:57.130263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:57.137756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:57.139248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:57.140195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:57.141025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:57.141644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:57.141924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:57.143269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] RBAC: Adding query filter params (interface=public, service_id=850f527811a44a178faf2830fef2e9ba, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:57.143590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:57.145098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:46:57.153091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:57.154064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:46:57.154964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:57.156651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 459/908] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/endpoints?service_id=850f527811a44a178faf2830fef2e9ba&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:57.158289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:57.159681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 450/909] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:57.160672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:57.276718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938115-66f6-496b-8491-2c4dcd124d5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:57.276899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c34af4-8c02-4888-a314-fe5243afaa4f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:57.295097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:57.314171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:57.314793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:57.315075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:57.315348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:57.316033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:57.317369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:57.317522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:57.318391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:57.318873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:57.319370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:57.320304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:57.320888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:57.322495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983187b-9de1-4500-ac1a-88e4b941f30e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:57.323873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 460/910] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:46:57 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:46:57.337404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 451/911] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:57.344021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:57.457158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71148-a904-4363-8e01-662fcad76110 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:57.498670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:57.499289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:57.499570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:57.499873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:57.500658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] RBAC: Adding query filter params (role.id=7c6a107ae284453986ae63893fd8002c, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a720e28d18904eacaf37c162a398c288) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:57.500966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:57.502388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba566f-e288-47af-a6d6-bda390507270 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:57.508704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 461/912] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:46:57 2022] GET /identity/v3/role_assignments?user.id=a720e28d18904eacaf37c162a398c288&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=7c6a107ae284453986ae63893fd8002c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:58.107203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48040d59-95a9-44a3-ab19-3320768f43c5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.107737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48040d59-95a9-44a3-ab19-3320768f43c5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.107737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48040d59-95a9-44a3-ab19-3320768f43c5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.109330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 452/913] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:58.114901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.115892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.116093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.136444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:58.137988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:58.182672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:58.219865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 462/914] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:58.235348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48040d59-95a9-44a3-ab19-3320768f43c5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:58.258609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:58.349969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48040d59-95a9-44a3-ab19-3320768f43c5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:58.390841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:58.391941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.392427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.392877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.393693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:58.395247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:58.405511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:58.406523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 20:46:58.407648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:58.409969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 453/915] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:58.415994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:58.526386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b03b9-3bd3-488e-aae8-f3d8b4291bc7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:58.566799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:58.567844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.568337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.569405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.570330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:58.570851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:58.572529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff552-7eb0-4b4a-b361-a1a415b2e736 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:58.578882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 463/916] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:58.584937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:58.680251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:58.704782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbbc49-0f18-4b09-98e0-4d96dd60fced None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:58.719300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf348f-1665-4158-aa55-da3493c2bc9a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.719604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf348f-1665-4158-aa55-da3493c2bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.719891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf348f-1665-4158-aa55-da3493c2bc9a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.721397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 464/917] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:58.726644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.727206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.727691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.745094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:58.746161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.746649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.747169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.748209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:58.748455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:58.748954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:58.749640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:58.750750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:58.761839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 454/918] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 4 20:46:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:58.763329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:58.788009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:58.845647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 465/919] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:46:58.868264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:58.875015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff665-fe86-46dd-9c6e-7e350e8ab8bd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:58.925940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:58.926655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:58.926939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:58.927215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:58.928326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:58.929711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:58.951074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:58.958103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 455/920] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:46:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:46:58.995536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71306279-7c0b-4373-99a8-fcf937ba4ed8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.048196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.048925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.049260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.049540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.050186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.051656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:59.062038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:59.063126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.064278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 466/921] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:46:59.072946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.187237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8348c1-0713-4f6e-8fc8-f2faa5cc433c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.224863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.225852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.226359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.226839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.227780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:59.228383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.230031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.239850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 456/922] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:59.242284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.274076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:59.348634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fdf5-0d62-429a-9784-898b50c4b7ba None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.388799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.389792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.390276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.390747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.391624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:59.392173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.393767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29c4c4-8251-4bbf-a918-689a91cce0c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.399707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 467/923] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:59.405695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.476367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:59.491509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4114bd8-0183-4cc3-854e-cc659d0da275 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.491839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4114bd8-0183-4cc3-854e-cc659d0da275 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.492091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4114bd8-0183-4cc3-854e-cc659d0da275 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.493766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 468/924] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:46:59.499054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe614a-15eb-4580-8ebd-b17c9c7a0dd3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.499626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe614a-15eb-4580-8ebd-b17c9c7a0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.500128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe614a-15eb-4580-8ebd-b17c9c7a0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.518663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b6fe614a-15eb-4580-8ebd-b17c9c7a0dd3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:59.520264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b6fe614a-15eb-4580-8ebd-b17c9c7a0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:59.533191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6a9c2-f0d5-4ce5-b659-12f8f5ac0ed7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.572620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.573312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.573526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.573798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.574750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] RBAC: Adding query filter params (interface=public, service_id=283a21cda32d4565a19fa47ebd67d376, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:46:59.574887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.576365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da185f-773a-4654-ac87-8ea1f26f3bdf None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.586945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 457/925] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/endpoints?service_id=283a21cda32d4565a19fa47ebd67d376&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:46:59.586945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e3ea0-9466-4152-a106-1ca5ebb08fc0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.586945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e3ea0-9466-4152-a106-1ca5ebb08fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.586945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e3ea0-9466-4152-a106-1ca5ebb08fc0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.586945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 458/926] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:46:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:46:59.590270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e3ea0-9466-4152-a106-1ca5ebb08fc0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.596442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 469/927] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:59.599793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.599793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.599793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.620752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:46:59.622203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:46:59.640656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:59.697415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 470/928] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:46:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:46:59.698389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.712072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e3ea0-9466-4152-a106-1ca5ebb08fc0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.742360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:59.750525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.751154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.751438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.751715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.752411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.753793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.760205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 459/929] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:46:59.760990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.851401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237eb5c-45e6-4274-813b-5f774ddc6c15 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.888564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109b6-8469-4fdb-874c-dd75b96d4bad None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:46:59.888775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.889467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.889755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.890034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.890689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:46:59.892138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:59.903980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:59.905051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:46:59.905939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 471/930] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:59.911693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:46:59.936078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:46:59.942138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:46:59.943136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:46:59.944119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:46:59.944396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:46:59.955416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:46:59.961670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:46:59.962626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:46:59.963519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 460/931] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:46:59.969169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.035531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131680-a970-4a07-a5bf-6a06d810836c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.042704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:00.074497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.075130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.075413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.075677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.076391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:00.076695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.078066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.087780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 472/932] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:00.091981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.112312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f3d9-ab0c-4a08-b63f-d18cddc4fd24 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.150765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.151408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.151672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.151990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.152711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:00.153019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.154412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.163949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 461/933] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:46:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:00.169379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.200355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:00.231780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632f40f-c061-4a7c-b87d-27b571e591e2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.268077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.268753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.269030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.269309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.269992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:00.270300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.272337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.278217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 473/934] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:00.283585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08a34e-accb-40a2-9be9-9f0267f9729e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.284405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.301003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:00.322894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.323737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.324152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.324564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.336641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.338222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:00.353687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:00.354848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:00.356063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:00.356063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:00.356063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:00.356063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:00.357440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 462/935] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:00.362856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.418082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacce6a-97f8-434b-bd5b-172268c4a142 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.463772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.464997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.465868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.466378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.467321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.470200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.481752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb485e0-842c-4c79-a97c-d3d8e3392209 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.490209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:00.498017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 474/936] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:47:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:00.541907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.542750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.543132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.543506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.544421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:00.544836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.546432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.561552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 463/937] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:00.567667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.686567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a523608-0718-49cd-a491-b703e4f1cd42 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.721254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.721892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.722177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.722449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.731343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.732834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:00.746707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:00.747716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:00.748740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 475/938] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:00.755326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.781858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:00.863031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b9e3-5b8a-4801-95ed-42d20a0571b5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:00.899928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:00.900917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:00.901416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:00.901894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:00.902937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:00.903443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:00.905091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:00.924711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 464/939] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:00.930672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:00.995882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.046768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497651e8-4017-46e7-9c32-0abd94524741 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.088295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.089394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.089904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.090389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.102673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.104456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a96bdb69-6f36-430f-8843-c95387dc34b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:01.120144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:01.121143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:01.122160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:01.122160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:01.122160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:01.122160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.124952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 476/940] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:01.131353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.215235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.232083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918129b-7e3a-4172-a4a4-4e347619cf70 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.232769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918129b-7e3a-4172-a4a4-4e347619cf70 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.233250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918129b-7e3a-4172-a4a4-4e347619cf70 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.235260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 477/941] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:01.240353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.241119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c797-c472-4e2e-af49-273fda808631 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.241618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.242117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.265225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:01.266900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:01.283775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.284474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.284724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.284999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.285856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:01.286300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.288424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.309247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 465/942] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:01.310283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.359782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 478/943] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:01.381310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.422396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd294b-e517-46f4-bd12-1074052abb37 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.461674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.462676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.463196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.463709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.464125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.472005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.473768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.476685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:01.488211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:01.489158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:01.490638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:01.497708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 466/944] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:01.498791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.504941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1104efb-0c84-4f2e-8b46-3903a6165136 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.544483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.545210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.545583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.545931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.546752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.548621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.551079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING keystone.server.flask.common [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 20:47:01.569343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.sql.core [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 20:47:01.569343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 20:47:01.569343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [parameters: {'id': '0121b3acca6946f1a3e29d855980ce42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 20:47:01.569343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0121b3acca6946f1a3e29d855980ce42.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0121b3acca6946f1a3e29d855980ce42. Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:47:01.588121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 20:47:01.589023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application yield resource Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise self.value Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application session.commit() Aug 04 20:47:01.590017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.session.flush() Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application compat.raise_( Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 20:47:01.590939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 20:47:01.591906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application result.read() Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:47:01.592749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [parameters: {'id': '0121b3acca6946f1a3e29d855980ce42', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.593739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:01.595935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0121b3acca6946f1a3e29d855980ce42. Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 479/945] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Aug 4 20:47:01 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:01.597861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.634981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce877515-4d96-4c66-a380-4747bb1ee4ff None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.672656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.673736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.674231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.674740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.675690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:01.676244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.678405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.696722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 467/946] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:01.698003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.702026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.706220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e145b3-ac48-47f7-afbc-ee76483f154b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.744708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.745418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.745748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.746025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.754317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.756676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:01.769837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:01.770839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:01.771900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 480/947] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:01.775264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:01.777805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:01.821658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8c59a-bbd3-4ed6-b620-3d2a70d25231 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.866015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.866689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.866973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.867249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a720e28d18904eacaf37c162a398c288/roles/7c6a107ae284453986ae63893fd8002c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.869517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=a720e28d18904eacaf37c162a398c288, role_id=7c6a107ae284453986ae63893fd8002c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.871457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48242a57-43f8-491b-a887-364a9c09b7ad None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.888176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 468/948] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:47:01 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a720e28d18904eacaf37c162a398c288/roles/7c6a107ae284453986ae63893fd8002c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:47:01.889363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d0ec-baab-42ba-8c7c-8bd881d3f41b None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.889654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d0ec-baab-42ba-8c7c-8bd881d3f41b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.889937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6d0ec-baab-42ba-8c7c-8bd881d3f41b None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.891869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 469/949] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:01.896881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.897163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.897444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.908939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d81db6-011b-41b5-8c2a-1e0eb5a84d6b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:01.917584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:01.918801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:01.956424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:01.957780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:01.958252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:01.958707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:01.959675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:01.960209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:01.962256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:01.996717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 481/950] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:02.012360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 470/951] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:02.031604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:02.057883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:02.156513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89258c5-cc67-46f2-b6f4-6c82c47facd8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:02.193731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:02.194388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.194671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.194945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.195576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:02.196992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:02.206969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:02.208180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:02.209643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 482/952] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:47:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:02.215002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:02.275914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:02.332740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fd22-2e43-4c94-b8d3-af6b7817a139 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:02.371553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:02.372748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.373251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.373735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.374643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:02.375173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:02.376798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:02.382667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 471/953] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:02.388579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:02.494454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:02.515270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c2e04-060a-44b6-ac44-16d71244126a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:02.550975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:02.551603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.551919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.552196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.553430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:02.553738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:02.555231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d6c32-c5e9-4b9e-964f-b6dd096ee524 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:02.561055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 483/954] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:02.566272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:02.674873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aab186-0b35-4fd0-b4f1-f42da2b66feb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:02.689659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:02.699213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bee-1f62-4f20-b97e-199991208df1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.699501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bee-1f62-4f20-b97e-199991208df1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.699919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bee-1f62-4f20-b97e-199991208df1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.701674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 484/955] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:02.706536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.706829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.707109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.715667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:02.716255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.716597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.716875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.717742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:02.719133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:02.727830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:02.729877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:02.743259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 472/956] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:47:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:02.822927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 485/957] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:02.844680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:02.955940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3a8a6-817b-469f-81b0-6c16d098b07d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:02.989909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:02.991031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:02.991315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:02.991593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:02.992259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:02.993644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:03.003202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:03.004421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:03.005349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 473/958] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:03.010538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:03.090442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:03.122522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef038-6edf-459a-a03e-d76895577c90 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:03.158188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:03.158859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:03.159153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:03.159420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:03.160123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:03.160429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:03.161787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337a388-d3f8-467f-a714-dd62f62d1203 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:03.167574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 486/959] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:03.173064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:03.226506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:03.289770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85af8de-07fa-4204-8297-238ce4db2384 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:03.326627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:03.327260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:03.327557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:03.327902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:03.328586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:03.328895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:03.330270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc5fe7-e8f1-4642-a2c2-2ead76fa7b05 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:03.335760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 474/960] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:03.984389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4594958-5dad-409d-9a51-da9c1124fafa None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:03.985370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4594958-5dad-409d-9a51-da9c1124fafa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:03.985879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4594958-5dad-409d-9a51-da9c1124fafa None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:03.987683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 487/961] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:03.993032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3a1f-bdc0-49be-b40c-ef3d9ea56bf7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:03.993558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3a1f-bdc0-49be-b40c-ef3d9ea56bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:03.994039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3a1f-bdc0-49be-b40c-ef3d9ea56bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.012465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-236f3a1f-bdc0-49be-b40c-ef3d9ea56bf7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:04.014166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-236f3a1f-bdc0-49be-b40c-ef3d9ea56bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:04.084213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 475/962] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:04.107479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4594958-5dad-409d-9a51-da9c1124fafa None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.217618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4594958-5dad-409d-9a51-da9c1124fafa None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.252289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.252754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ccbf-0f81-4ec4-878e-9c6667e155bf None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.252926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.253030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ccbf-0f81-4ec4-878e-9c6667e155bf None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.253175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.253334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ccbf-0f81-4ec4-878e-9c6667e155bf None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.253502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.256474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 476/963] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:04.256949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:04.260527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.260812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.261096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.265350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:04.272216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:04.273178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:04.274041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 488/964] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:47:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:04.284205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.285464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:04.286655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:04.311142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:04.377216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 477/965] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:04.408348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.447736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241e9a-4428-46c9-a620-ced4ade663bc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.518907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.519996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.519996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.519996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.523775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:04.523775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:04.523775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:04.538463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 489/966] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:47:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:04.539695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.622244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:04.629677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53d84-1a38-4bf3-be6f-a351a6234d05 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.672422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4483-da0f-48cd-bd2a-e3155976671a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.714167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.714969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.715275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.715538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.720406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:04.722285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:04.726608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.728865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING keystone.server.flask.common [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 20:47:04.729609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.730086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.730550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.753011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:04.755105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:04.760895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.sql.core [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 20:47:04.760895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 20:47:04.760895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [parameters: {'user_id': 'df2eac9464d84eb581ffc0dc94f2dbe8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 20:47:04.760895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80218) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() Aug 04 20:47:04.768113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:47:04.769020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application yield resource Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application next(self.gen) Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise self.value Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application session.commit() Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 20:47:04.770007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.session.flush() Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application compat.raise_( Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 20:47:04.770927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 20:47:04.773895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application conn.query(q) Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application result.read() Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 20:47:04.775909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [parameters: {'user_id': 'df2eac9464d84eb581ffc0dc94f2dbe8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:04.777853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 20:47:04.779963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 20:47:04.785048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:04.791176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 478/967] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 4 20:47:04 2022] POST /identity/v3/users => generated 160 bytes in 383 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:04.793806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:04.807223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:04.808463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:04.809424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:04.809424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:04.809424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:04.809424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:04.817118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 490/968] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:04.818308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:04.852264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:04.951793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3586a-dfb7-41ae-b107-1a8107adcd21 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.963345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f60d8-45f1-40c3-90e6-fd5e55f11398 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:04.963844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:04.990246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.990936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.991141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.991420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:04.992140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:04.992448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:04.994083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bd098-44da-4112-954b-c1d25db3454c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:04.998232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:04.998869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:04.999149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:04.999511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.011402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 491/969] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:05.011582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.011679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf386-6941-4388-b55a-479f67f68d08 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.011679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf386-6941-4388-b55a-479f67f68d08 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.011679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf386-6941-4388-b55a-479f67f68d08 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.012292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.012383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 492/970] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:05.012921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf386-6941-4388-b55a-479f67f68d08 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a35922df-0fd4-449e-9a8d-55776a43ce7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:05.026929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:05.027965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 20:47:05.028952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:05.033014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 479/971] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:05.034269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.034838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.035128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.053818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:05.055394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:05.122250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf386-6941-4388-b55a-479f67f68d08 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.139765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 480/972] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:05.139765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.149716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.159917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.160563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.161145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.161145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.169009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.170447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:05.182649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:05.183646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:05.184698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 493/973] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:05.188627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.221444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.246441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fc3e-306a-4195-96ce-a8fc96a7e0f4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.281865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.282675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.282960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.283235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.284022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:05.284329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.285762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.302804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada25d7-c82c-4d11-a0a0-d04e71174540 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.323293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 481/974] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:05.324180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.347536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.348525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.348959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.349992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.350888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.352656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:05.365909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:05.367223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:05.368226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:05.374901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 494/975] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:05.375627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.422446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.467699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902a37-1ccc-403d-8df9-22550d5926b1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.504299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.509083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.509917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.510199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.510473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.511273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:05.511581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.511989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeb169-111f-46bc-bf14-11907baf1e87 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.513073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf318442-db76-4e09-8855-e1f5f935a8e4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.531050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 482/976] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:05.532665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725419-d581-40ec-8486-2e2cd7a78564 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.532892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725419-d581-40ec-8486-2e2cd7a78564 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.533169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e725419-d581-40ec-8486-2e2cd7a78564 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.534420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 483/977] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:05.537600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725419-d581-40ec-8486-2e2cd7a78564 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.553118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.553118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.553118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.553118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.553569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:05.553768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.556860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3f4dd-db27-4620-be75-a91b2e442b2a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.560645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 495/978] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:05.562019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.562309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.562595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.586107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:05.587529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:05.646751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e725419-d581-40ec-8486-2e2cd7a78564 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.655422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 496/979] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:05.656391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.676797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.686516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.687137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.687417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.687690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.743404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.756049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.756795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ecdb-e7fb-43f9-a7c9-7b71c6af2f30 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.757527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.790691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.791237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.791518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.791816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.792492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:05.792797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.794151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.799055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 497/980] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:05.800040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.857209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 484/981] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:05.858046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.886406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:05.900340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca582c-9b68-4576-9a5a-0c5bbd875a28 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.934358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:05.934972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:05.935255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:05.935530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:05.936251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:05.937616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:05.951709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 498/982] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:47:05 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:05.952552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:05.960611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78226-8c20-4e37-9e8c-091b25d510ab None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:05.969894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:06.012277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.012917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.013205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.013482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.014257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] RBAC: Adding query filter params (interface=admin, service_id=283a21cda32d4565a19fa47ebd67d376, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:06.014576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.016102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.022415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 485/983] 10.222.0.45 () {56 vars in 1249 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/endpoints?service_id=283a21cda32d4565a19fa47ebd67d376&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:06.028138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:06.078643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9ccb9-225f-4834-92e8-c1e6ccd83caa None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.121225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.121460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.121630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.122585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.123136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:06.138418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.140021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.141377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c314f8-5c2a-4c83-94a5-ba3c45b63e89 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:06.155533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:06.156742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:06.157936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:06.157936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:06.157936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:06.157936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:06.159899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 499/984] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:06.163395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:06.180587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.181218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.181497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.181759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.182405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.183810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.199777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 486/985] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:47:06 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:47:06.232697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:06.277473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0788f-8322-43b1-9085-8e43528fb283 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.313919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.314546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.314822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.315095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.315821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:06.316125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.317516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.335561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 500/986] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:06.337420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:06.446300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53cd8-ecdc-4d13-829a-27f738cb4b5a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.487069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.487718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.488032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.488311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.495830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.497393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:06.509201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:06.510143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:06.511083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:06.515135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 487/987] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:06.516507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:06.621903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297c174-2a53-40aa-a395-325e9139b90f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.646001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:06.658105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.658714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.658989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.659257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.660039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:06.660347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.662303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ee052-c015-4322-b498-85a291bf4730 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.679818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 501/988] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:06.681718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:06.695107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:06.790252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609710f-a2fe-4ed6-b9e1-45a3a0e17dd7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:06.823764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:06.824393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:06.824680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:06.824956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:06.825738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] RBAC: Adding query filter params (role.id=7c6a107ae284453986ae63893fd8002c, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a720e28d18904eacaf37c162a398c288) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:06.826050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:06.827674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0add-34f1-47bd-895d-92b4e5c799ac None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:06.839868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 488/989] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:06 2022] GET /identity/v3/role_assignments?user.id=a720e28d18904eacaf37c162a398c288&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=7c6a107ae284453986ae63893fd8002c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:07.986348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159039b4-c2e7-45ba-bfbf-bcc3d20ad7ba None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:07.986884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159039b4-c2e7-45ba-bfbf-bcc3d20ad7ba None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:07.986884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159039b4-c2e7-45ba-bfbf-bcc3d20ad7ba None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:07.988433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 502/990] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:07.993452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bbe-aa48-41d0-b3f2-bb2a19e6e645 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:07.993840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bbe-aa48-41d0-b3f2-bb2a19e6e645 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:07.994005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79bbe-aa48-41d0-b3f2-bb2a19e6e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.012373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-14a79bbe-aa48-41d0-b3f2-bb2a19e6e645 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:08.013559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-14a79bbe-aa48-41d0-b3f2-bb2a19e6e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:08.080910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 489/991] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:08.103100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159039b4-c2e7-45ba-bfbf-bcc3d20ad7ba None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.198368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb00-8258-41ec-a094-081535d3e6e6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.198663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb00-8258-41ec-a094-081535d3e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.198947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb00-8258-41ec-a094-081535d3e6e6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.200350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 490/992] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:08.205080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.205366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.205645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.212839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159039b4-c2e7-45ba-bfbf-bcc3d20ad7ba None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.213533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.224338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:08.225535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:08.249199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.250124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.250573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.250991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.251899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.253539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:08.263388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:08.264677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:08.265756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:08.273222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 503/993] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:08.274215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.295509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 491/994] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:08.318590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.327808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.381666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98e523-a7d4-4639-92bd-2c9b24af62d0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.423468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.423677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201e30b-3819-4f55-9eea-a21d51b0e560 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.424141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.424427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.424709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.425391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:08.425697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.427094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.433166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 504/995] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:08.438652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.472269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.473225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.473671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.473964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.474608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.476060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.477888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:08.486801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:08.488192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 20:47:08.489267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:08.497699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 492/996] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:08.498423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.551631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4046525-d140-4c4f-bf33-d53681e28647 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.565466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.586767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.587391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.587680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.587986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.588772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:08.589082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.590467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.595479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 505/997] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:08.602581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.621167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7442c32-0b95-4a71-ba27-56758767bd85 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.657981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.658942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.659233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.659517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.660232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:08.660543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.661959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.667040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 493/998] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:08.672615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.714316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fdea3-c503-4926-9f41-ef62026ebc5a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.741026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.749475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.750114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.750385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.750662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.751422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] RBAC: Adding query filter params (interface=public, service_id=45acc7d535584bb388827e2b2cfc295e, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:08.751733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.753133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.763338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 506/999] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/endpoints?service_id=45acc7d535584bb388827e2b2cfc295e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:08.764427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.790074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae9f1-8990-4fb4-9d58-24f2ca4243cb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.808158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.827732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.828382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.828662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.828938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.829616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:08.829921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.831297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.837105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 494/1000] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:08.842678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:08.872687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517a891-2d79-472e-8401-f27e07e95a21 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.908891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.909516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.909801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.910080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.910737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.912202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f754-16e7-45a7-9d93-c13acc13a00e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:08.918500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 507/1001] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:47:08 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:47:08.919661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286952-cb17-4ab2-88d6-8e149af5d8fd None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.919981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286952-cb17-4ab2-88d6-8e149af5d8fd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.920256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da286952-cb17-4ab2-88d6-8e149af5d8fd None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.921631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 508/1002] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:08.927311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.927610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.927916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.949713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:08.950928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:08.955459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bfc05-cf85-4cb5-a8e2-24be8a180220 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:08.984553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:08.994775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:08.995487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:08.995892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:08.996073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:08.997519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:08.998251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:09.018746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 495/1003] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:47:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:47:09.047822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 509/1004] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:09.071664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:09.187815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bacccb-f613-4c47-a426-75e7db835b38 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:09.224567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:09.225594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:09.226086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:09.226584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:09.227441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:09.229137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:09.238521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:09.240182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:09.241072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:09.241854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 496/1005] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 4 20:47:09 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:09.247542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:09.278438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:09.350151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c764c-8cb1-4ff3-899a-77b35fc00efb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:09.384561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:09.385182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:09.385458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:09.385726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:09.386394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:09.386694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:09.388102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cfcb4-905d-422e-bef9-d1a41043fae0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:09.393457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 510/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:09.399305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:09.456930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:09.516058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce2285-beff-4d6e-8e34-7bac1b35baf9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:09.550212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:09.550825 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:09.551105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:09.551373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:09.552115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] RBAC: Adding query filter params (type=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:09.552947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:09.554313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48315f-0d85-47eb-97bb-9d6265a5a969 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:09.558892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 497/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:10.962037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500cc1-d6c1-4132-a091-cba21eb9b2d5 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:10.962831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500cc1-d6c1-4132-a091-cba21eb9b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:10.962831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75500cc1-d6c1-4132-a091-cba21eb9b2d5 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:10.964241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 511/1008] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:10.969217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:10.969668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:10.969862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:10.988715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:10.989973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:11.038644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca83a9-fa33-4fc7-8e74-f6ee89e02480 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.038992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca83a9-fa33-4fc7-8e74-f6ee89e02480 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.039209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca83a9-fa33-4fc7-8e74-f6ee89e02480 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.040865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 512/1009] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:11.045570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.045862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.046151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.065652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 498/1010] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:11.069722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:11.070912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:11.088779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.142788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.153485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 513/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:11.176545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.201337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.218227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb776b7-8325-4692-aff4-88c822abf04b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.259892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.260554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.261139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.261139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.261763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.263161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:11.275600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:11.276671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:11.280837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 499/1012] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:11.282986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.296253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970a942-4973-42af-aeb1-efb705fe45a9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.339577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.340253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.340542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.340821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.342423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.343900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.345519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 514/1013] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:11.352116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.395228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c43478-13bf-496e-b750-0c0ef2d3cc88 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.404852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.433017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.433642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.433927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.434207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.434891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:11.435201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.436616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.446410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 500/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:11.447307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.451969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.470293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e506f6c-5a8b-4840-8921-d649eb93cd27 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.507229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.508183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.508652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.509185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.510076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.511707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35064b6e-a8a1-4087-9237-e13a2d858bd5 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.551800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 515/1015] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:47:11 2022] POST /identity/v3/projects => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:47:11.574617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc703c-fafe-434f-922a-f96bd1cb66b8 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.577537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a461a1-f6fb-4282-9ac0-9a67186f9e6d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.577826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a461a1-f6fb-4282-9ac0-9a67186f9e6d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.578102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a461a1-f6fb-4282-9ac0-9a67186f9e6d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.579523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 516/1016] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:11.585176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.585493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.585739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.605541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:11.606779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:11.623464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.624248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.624535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.624842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.625541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:11.625852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.627286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.641523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 501/1017] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 4 20:47:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:11.642735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.691634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.698885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 517/1018] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:11.724613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:11.773995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074e12-0d52-496f-8fbd-3c21e442b0ab None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.811062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:11.814380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.815555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.816091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.816625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.818193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.819613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646f227-522a-4967-8673-0f2ffe0da411 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.851785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 502/1019] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:47:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:11.852036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aae261-45b4-421f-9454-0e0ddfd75d69 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:11.902832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:11.903967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:11.904258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:11.904535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:11.905276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:11.906721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4229-6e2c-4f43-b4de-f2966fd0ed8e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:11.931236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 518/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:47:11 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:13.606911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6748f-7400-4612-818a-f1fe51a1fea8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:13.607475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6748f-7400-4612-818a-f1fe51a1fea8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:13.607700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6748f-7400-4612-818a-f1fe51a1fea8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:13.609187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 503/1021] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:13.615457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:13.615944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:13.616022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:13.634750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:13.635968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:13.711797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 519/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:13.736912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6748f-7400-4612-818a-f1fe51a1fea8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:13.833486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:13.845807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6748f-7400-4612-818a-f1fe51a1fea8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:13.894386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:13.895045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:13.895326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:13.895635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:13.896912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:13.898384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e7f67-e9c1-46f2-a79c-e7754a8a2183 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:13.900263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 504/1023] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:13.909123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:13.968735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:13.982135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e7eaf-a3d7-4c6e-aac7-6e2849147231 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:13.982423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e7eaf-a3d7-4c6e-aac7-6e2849147231 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:13.982701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e7eaf-a3d7-4c6e-aac7-6e2849147231 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:13.984098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 505/1024] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:13.989181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862016-c5ca-461a-84a5-aae9023ec34c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:13.989546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862016-c5ca-461a-84a5-aae9023ec34c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:13.989964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862016-c5ca-461a-84a5-aae9023ec34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.009167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4c862016-c5ca-461a-84a5-aae9023ec34c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:14.010360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4c862016-c5ca-461a-84a5-aae9023ec34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:14.025688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb02f6-624d-40c8-9289-c73f2bd79d1a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.059499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.060149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.060435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.060705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.061455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.062822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.078965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 506/1025] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:14.080269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819b81-79f9-4893-b8eb-645f01fecd9f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.080560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819b81-79f9-4893-b8eb-645f01fecd9f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.080849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb819b81-79f9-4893-b8eb-645f01fecd9f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.082285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 507/1026] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:14.087788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.088251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.088665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 520/1027] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:47:13 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:47:14.088810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.106361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.113788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:14.115062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:14.199839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 508/1028] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:14.218183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.225898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356066-d5df-4baf-9d90-0a2946e38296 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.239557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.246720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.266516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.267168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.267450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.267722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.280784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:14.287144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:14.288226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:14.289125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 521/1029] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:14.294480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.357369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950074a-bba7-4f2c-9a3d-beb435903237 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.393191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.393831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.394191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.394442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] PATH_INFO: `/v3/services/image` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.394993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.397052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.402770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f4d50-df4d-4490-88c1-cba0d8e49455 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:14.406108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:14.407418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:14.413564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 509/1030] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:14.416314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.442673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.443291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.443579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.443882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.444599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:14.444904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.446267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.454905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 522/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:14.463215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.499217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.520160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.535574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3723a8f-96ff-41ae-ba39-a4258c531c4e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.571510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.572159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.572443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.572558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ed67f-e282-451b-9430-9f05e0127adc None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.572719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.573386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] RBAC: Adding query filter params (name=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:14.573743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.575126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.580279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 510/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:14.587528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.613892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.614589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.614873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.615145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.626073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.627520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:14.642509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:14.643457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:14.645198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:14.645198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:14.645198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:14.645198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:14.645198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 523/1033] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:14.649785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.705292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456282f-937b-4f40-a3f1-377ab73f229d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.740848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.741491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.741771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.742041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.742705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] RBAC: Adding query filter params (type=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:14.743004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.743260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.744416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.750046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 511/1034] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:14.756301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.759163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb9d89-ee35-4bfc-9804-3d6f65cbb47d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.772200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:14.797467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.798090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.798372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.798645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.799334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:14.799642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.801040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.813681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 524/1035] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:14.819555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.868472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174cb64-3bf8-456b-9fb0-d2d5f3671f8c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.905239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.905867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.906163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.906423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.907449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] RBAC: Adding query filter params (interface=public, service_id=9653a798cb034a15ab644b4593e1f0ec, region_id=RegionOne) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:14.907789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.909178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.914864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 512/1036] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/endpoints?service_id=9653a798cb034a15ab644b4593e1f0ec&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:14.920192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:14.933717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508de65-2467-4b1e-8701-14c1f7ff0de1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:14.972237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:14.972876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:14.973159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:14.973438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:14.981263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:14.982703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:14.995547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:14.996691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:14.998189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 525/1037] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:15.002333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:15.005533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:15.012490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:15.034071 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cec8-d1d4-4048-8694-12180e65f797 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.072107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:15.072727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:15.073004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:15.073275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:15.074029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:15.075520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:15.091849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 513/1038] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:47:14 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:47:15.117800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26020f26-65f5-41ce-835f-53e08f582388 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.155512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:15.156180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:15.156466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:15.157009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:15.157819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:15.158130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:15.159600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:15.180027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 526/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:47:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:15.185629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:15.303184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188aba-89b9-4791-a614-eb6dcbd25bf5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.337637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:15.338260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:15.338538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:15.338808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:15.349560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:15.409354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:15.410801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:15.522511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 514/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:15.524315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:15.590899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:15.630660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329171e7-71ab-4779-b90c-bd2b23a650d6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.665232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:15.665867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:15.666145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:15.666417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:15.676351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:15.677804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:15.692197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:15.699936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:15.701199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:15.701199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:15.701199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:15.701199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:15.701199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 527/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:15.703805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:15.748548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:15.811141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7e13-bfa9-42c9-be16-34efc87fe877 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.846047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:15.846595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:15.846880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:15.847158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:15.847874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:15.848190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:15.850286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:15.866640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 515/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:15.867811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:15.970256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612768f-b095-4307-b8b2-74c187186dfe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:15.986506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:16.006035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.006663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.006944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.007222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.013961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:16.015420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d5adc624-d77c-4790-bb56-16239e95d850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:16.027380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:16.028325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:16.036023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 528/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:16.037218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.134980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:16.139120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038ef7b-b428-4bfd-8cfe-de1112fb2428 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.162262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b037-8485-4dc1-b4f8-5ddf9669ded8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.162554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b037-8485-4dc1-b4f8-5ddf9669ded8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.162828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b037-8485-4dc1-b4f8-5ddf9669ded8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.164389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 529/1044] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:16.169087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.169381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.169660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.178055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.178684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.178972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.179249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.180155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:16.180468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:16.181903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:16.188816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:16.190050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:16.197300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 516/1045] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:16.203494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.267021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 530/1046] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:16.290495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.310174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca14eec-eab2-452d-ba7a-1e2f5be7f39f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.346912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.347525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.347846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.348123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.349495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] RBAC: Adding query filter params (role.id=7c6a107ae284453986ae63893fd8002c, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:16.349806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:16.351311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:16.357274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 517/1047] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=7c6a107ae284453986ae63893fd8002c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:16.400852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2247-8722-4b8f-96c1-a52a26545113 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.410297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:16.441555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.442230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.442509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.442780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.454258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:16.463801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:16.464928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:16.465783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 531/1048] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:16.467815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.498151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:16.578654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a1696-2fe6-40d1-be56-c962a84a3591 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.613717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.614371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.614656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.614934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.615649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:16.615989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:16.617371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:16.630492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 518/1049] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:16.631762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.744958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d0bc7-58ab-4f19-9e5f-7531d24086bd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.780685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.781418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.781955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.782228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] PATH_INFO: `/v3/users/37b14fb8a8114145841a459b53fd931d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:16.796452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] RBAC: Authorizing `identity:get_user(user_id=37b14fb8a8114145841a459b53fd931d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:16.797903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb123-7b8f-414a-8224-f6aca2d24364 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:16.803899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 532/1050] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/users/37b14fb8a8114145841a459b53fd931d => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:16.807097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:16.896456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:16.913639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d6505-72a2-4620-b522-8f80620ad763 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:16.952484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:16.953112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:16.953395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:16.953677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.021874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.023284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.106881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.122960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98b3-0787-4ad4-be9f-53208c9213d0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.123239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98b3-0787-4ad4-be9f-53208c9213d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.123566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e98b3-0787-4ad4-be9f-53208c9213d0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.125256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 533/1051] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:17.127003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 519/1052] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:17.130017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.130304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.130579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.132218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.149621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:17.151068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:17.171107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.224115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 534/1053] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:17.238655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992fd95-7947-4d5e-b6f3-c452c9bf61ef None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.245746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.274575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.275147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.275542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.275851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.277138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.278587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.285674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 520/1054] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:17 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:17.286724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.344773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.349151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8868f5-3051-40a0-8dad-0be35077c292 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.385103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.385736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.386176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.386613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] PATH_INFO: `/v3/services/image` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.387208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.388668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.396311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d51080-3ad0-42a0-97df-26d1c1e5920f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:17.398084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:17.399098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:17.400011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 535/1055] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 4 20:47:17 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:17.405204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.427096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.437481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.438108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.438398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.438673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.439459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05, user.id=37b14fb8a8114145841a459b53fd931d) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:17.439793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.441257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.447814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 521/1056] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:17 2022] GET /identity/v3/role_assignments?user.id=37b14fb8a8114145841a459b53fd931d&scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:17.533044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146afed-c8f1-4141-a523-cb946e26774d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.569088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.569724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.570004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.570276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.570964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] RBAC: Adding query filter params (name=image) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:17.571269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.572699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.578459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 536/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:17.584677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.694155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f5c2c-ed35-4f7f-a6c6-8ab1ebc4b3d7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.711135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.731957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.732738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.733024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.733294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.733977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] RBAC: Adding query filter params (type=image) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:17.734283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.735674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1d1dc-e12b-4e04-b8fc-0ec325519b00 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.741527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 522/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:17.746935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:17.832657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:17.853224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64921f47-79ce-4681-a74a-1e23d27d88ad None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:17.886251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:17.886871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:17.887150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:17.887418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:17.888177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:17.889635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773721ba-870b-4832-bf68-a9cb6b759e75 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:17.919809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 537/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:47:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:18.420582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533a0d-cd5b-4940-abed-183e20d92b5e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:18.421122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533a0d-cd5b-4940-abed-183e20d92b5e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:18.421370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a533a0d-cd5b-4940-abed-183e20d92b5e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:18.423326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 523/1060] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:18.429639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:18.429985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:18.430325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:18.448938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:18.450226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:18.529209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 538/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:18.552283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a533a0d-cd5b-4940-abed-183e20d92b5e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:18.658186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a533a0d-cd5b-4940-abed-183e20d92b5e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:18.693243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:18.693800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:18.694079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:18.694351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:18.704498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:18.709582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:18.710536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:18.711521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:18.712829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 524/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:47:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:18.716932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:18.778554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:18.820748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac35b14-d3ff-483d-a9db-5b97eaa4d5c6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:18.854146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:18.854812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:18.855093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:18.855366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:18.856103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:18.856407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:18.857765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:18.870649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 539/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:47:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:18.871933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:18.918369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:18.982322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b225-5021-491b-9eba-3b2cbfd47d28 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.023380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.024077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.024361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.024640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.035513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.037058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:19.055785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:19.056884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:19.058333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:19.058333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:19.058333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:19.058333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:19.058333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 525/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:19.063241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.215360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5455b04-8a37-416a-8993-ee51105e630c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.249318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.259442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.260423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.260847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.261286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.262169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:19.262624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.264297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c437da-d7dc-40ba-bde2-ff36bc55fe9a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.281177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 540/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:19.282672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.380457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.387936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829465-5878-4e95-b8c4-31d4840e9566 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.430314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.431202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.431600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.432019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.442087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.444752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.449315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b897053-8071-4d57-99e5-4d898672bc91 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.449603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b897053-8071-4d57-99e5-4d898672bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.449878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b897053-8071-4d57-99e5-4d898672bc91 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.453803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 541/1066] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:19.458741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.459025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.459304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:19.462430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:19.463377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:19.469471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 526/1067] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:19.470738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.485293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:19.486710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:19.563129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 542/1068] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:19.578218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f156d17-e678-4c19-8d9c-d693e56d45d1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.584757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.616265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.616890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.617177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.617461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.618246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:19.618558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.620038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.638383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 527/1069] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:19.643874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.659784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.691150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1de97-e77f-4ad5-ae08-4bc7034e59d4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.709585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.729976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.730623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.730903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.731177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.742030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:19.746956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:19.748185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:19.749141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 543/1070] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:19.754250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.756111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def77273-1b2a-4c92-9ad4-1cbefc9cfd94 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.793663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.794545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.794824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.795095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.807064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.808553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:19.824857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:19.825874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:19.826835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:19.826835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:19.826835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:19.826835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:19.826835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 528/1071] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:19.832270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.861513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6205f-e0fd-432d-b938-ced3e5a31643 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.901360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.902364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.903784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.904578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.905292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.907163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:19.908180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.909596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.918776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 544/1072] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:19.924502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:19.944170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60ee4-10f2-4d2b-8de3-663fb39a0fe7 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:19.967733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:19.980171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:19.980797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.981225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.981341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.982020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:19.982321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:19.983683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3d69-2230-491a-ad1b-d18094fd973e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:19.995438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 529/1073] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:19.996677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661207-8905-45ac-ac5f-9c69a80f18c8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:19.996962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661207-8905-45ac-ac5f-9c69a80f18c8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:19.997237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10661207-8905-45ac-ac5f-9c69a80f18c8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:19.998448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 530/1074] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:20.002062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10661207-8905-45ac-ac5f-9c69a80f18c8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.036547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184ddee-ee42-493c-bb3d-1c665191eb6f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.070501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.071150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.071429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.071704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] PATH_INFO: `/v3/users/37b14fb8a8114145841a459b53fd931d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.073768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] RBAC: Authorizing `identity:get_user(user_id=37b14fb8a8114145841a459b53fd931d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.075625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb808c39-f845-41a9-acc2-14eb165789b9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.077253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 545/1075] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:19 2022] GET /identity/v3/users/37b14fb8a8114145841a459b53fd931d => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:20.078485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.078861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.079369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.098733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:20.099965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:20.108549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10661207-8905-45ac-ac5f-9c69a80f18c8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.143533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.155126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.155818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.156101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.156387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.164116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.165558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.171771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 546/1076] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:20.172629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:20.177314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:20.178239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 531/1077] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:20.184292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.209827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.275779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb143-b5d1-465b-ac59-31d0d6adedf7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.287174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca0763-bbeb-4cea-b87a-a3cbcb183f02 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.311385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.312044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.312325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.312595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.313734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.315169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.316853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 547/1078] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:20.318120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.324453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.325125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.325410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.325737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.326434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:20.326742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.328204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.340920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 532/1079] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:20.341801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.386833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.423097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416f491-4222-4644-a326-79dc834fd5ac None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.425426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.445960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef5e71-c85e-40b1-8481-70234960b8f1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.461834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.462470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.462768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.463021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.481404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.482077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.482359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.482644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05/users/37b14fb8a8114145841a459b53fd931d/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.484634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] RBAC: Authorizing `identity:create_grant(project_id=dab69d5a66c34fa8b1acc629fe1f6d05, user_id=37b14fb8a8114145841a459b53fd931d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.486078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.500569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 533/1080] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:47:20 2022] PUT /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05/users/37b14fb8a8114145841a459b53fd931d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:47:20.501232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.551533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.553341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.613793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51920a-75b9-4626-9595-571f1d89c161 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.616382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.657222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.657914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.658192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.658467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/7c6a107ae284453986ae63893fd8002c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.661905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=fff966e741314bb8b510713bff46a08c, role_id=7c6a107ae284453986ae63893fd8002c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.663555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.676825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 548/1081] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:20.678527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 534/1082] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:47:20 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/fff966e741314bb8b510713bff46a08c/roles/7c6a107ae284453986ae63893fd8002c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:47:20.683546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.687965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:20.796356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007158-a929-4cad-ab13-9ce025a21237 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:20.835777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:20.836467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:20.836743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:20.837045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:20.847957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:20.849991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-cd8be731-44cc-45a6-998e-52ceed5c6ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:20.866051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:20.867428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:20.868904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:20.868904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:20.868904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:20.868904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:20.868904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 549/1083] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:20.873370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:20.996403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55fb1-2aa8-4469-a30b-27761a69342c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:21.043028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:21.043963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:21.044364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:21.044749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:21.045744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:21.046177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:21.048292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3c6ba-dc24-4df2-8b58-aa8ff9ec9be9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:21.071777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 535/1084] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:22.528510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95560-2035-4c05-97e7-077c2481ee4e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.529074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95560-2035-4c05-97e7-077c2481ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.529074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95560-2035-4c05-97e7-077c2481ee4e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.530422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 550/1085] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:22.536769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24b18-4ab1-471d-bc5c-9e95d5a6a4b8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.537209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24b18-4ab1-471d-bc5c-9e95d5a6a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.537353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24b18-4ab1-471d-bc5c-9e95d5a6a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.555767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-85a24b18-4ab1-471d-bc5c-9e95d5a6a4b8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:22.556997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-85a24b18-4ab1-471d-bc5c-9e95d5a6a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:22.574780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.625276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 536/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:22.647952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95560-2035-4c05-97e7-077c2481ee4e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:22.692547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cf8af-a546-4d2c-8056-9cb97df47b84 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.692836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cf8af-a546-4d2c-8056-9cb97df47b84 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.693120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cf8af-a546-4d2c-8056-9cb97df47b84 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.694839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 537/1087] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:47:22.699702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.700026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.700308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.706193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.718065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:22.719193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:22.751772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95560-2035-4c05-97e7-077c2481ee4e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:22.785144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:22.786295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.786570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.786665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 538/1088] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:22.786886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.797013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:22.802420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:22.803567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:22.804898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 551/1089] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:22.809518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:22.809648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:22.894934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.909158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b681-bb01-4d43-904e-a3614fdb0439 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:22.912124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c212-9d63-47d9-9bb0-5d7193e54f24 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:22.925591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:22.945414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:22.945866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:22.946044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.946321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.946476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:22.946585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.946752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:22.947030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:22.947729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:22.948056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:22.949424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:22.956815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:22.957982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 539/1090] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:22.962187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:22.963178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:22.964096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 552/1091] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 4 20:47:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:22.965890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:22.968967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.063239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd617-c23e-483b-9302-9a9d689fd2f6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.066271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c5f61-a2ca-4ed5-bb1e-120e9c21bb5b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.096357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.096996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.097276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.097549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] PATH_INFO: `/v3/users/37b14fb8a8114145841a459b53fd931d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.099348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] RBAC: Authorizing `identity:get_user(user_id=37b14fb8a8114145841a459b53fd931d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.100553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.100837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.101168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.101451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.101729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.102433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 540/1092] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:22 2022] GET /identity/v3/users/37b14fb8a8114145841a459b53fd931d => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:23.102538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:23.102736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.104129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.108080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.117291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 553/1093] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:47:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:23.118313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.123372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.157929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.207954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82bd6b-dc22-4ccf-8f38-ef9526f969fe None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.217047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77edf4-5ab6-424a-a4d6-6b9885857165 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.241132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.241679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.241958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.242230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.250512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.251144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.251430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.251704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.261994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.263437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:23.278189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:23.279122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:23.280485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:23.280485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:23.280485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:23.280485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:23.280485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 554/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:23.285173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.309311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.310805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.325685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.375293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.385924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd132ed-4bae-4a23-b912-55e9b3bdcd50 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.410051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 541/1095] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 20:47:23.416472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.420972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.421594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.421880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.422158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.422889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:23.423161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.424584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.438351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 555/1096] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:23.443982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.520329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc0e2d-41a4-4b65-a173-56a445072cef None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.535281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.556687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.557347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.557634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.557912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.559060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.560544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.562223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 542/1097] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:23.562927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b716c56-3061-4f22-a4ff-9fdf716b901e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.568287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.596356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.597002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.597279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.597552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.605065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.606776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:47:23.618609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:23.619797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:23.621195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 556/1098] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:47:23.625311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.637036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.670364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c5fe8-a8b9-4c31-8295-04dd728f4554 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.704704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.705312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.705595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.705861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.706640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05, user.id=37b14fb8a8114145841a459b53fd931d) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:23.706946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.708904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.714567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 543/1099] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/role_assignments?user.id=37b14fb8a8114145841a459b53fd931d&scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:23.727674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7249c0-3e08-48b0-98da-0718de481333 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.765681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.766311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.766590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.766863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:23.767677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:23.768016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:23.769495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:23.789138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 557/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:23.794864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:23.850585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:23.905212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b91a1-9873-4040-87d1-6609c8c0955f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:23.939648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:23.940306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:23.940591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:23.940865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.006659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.008152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.052325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:24.112096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 544/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:24.113366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:24.179106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:24.212448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98123e30-0c3a-4cd7-a091-460a97ed2a97 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:24.249339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:24.249976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:24.250254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:24.250531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.260585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.262031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:24.276220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:24.277314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:24.278242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:47:24.278242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:24.278242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:47:24.278242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:24.278242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 558/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:24.283261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:24.378379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23b27d-4886-4f86-ad32-da5f7e658d87 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:24.411430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:24.412065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:24.412346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:24.412615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.413291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:24.413590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.414959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.425762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 545/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:24.431862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:24.533246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c24306-4775-4631-9fd9-2131dfc2d23e None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:24.552719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:24.567319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:24.567988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:24.568272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:24.568549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.575050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.576530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:47:24.588841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:24.589925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:24.591249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 559/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:24.595783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:24.605648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:24.694947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b264-59a3-4c69-9660-7f1919adc12a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:24.728319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:24.728933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:24.729218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:24.729495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.730245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:24.730561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.732028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fc8a-607e-45d4-b0f9-2ac431164815 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.743824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 546/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:24.749941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:24.847314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0bb0-b7df-47c3-b669-7ce0bab91fab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:24.882614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:24.883225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:24.883504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:24.883809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:24.884592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] RBAC: Adding query filter params (role.id=7c6a107ae284453986ae63893fd8002c, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=fff966e741314bb8b510713bff46a08c) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:24.884900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:24.886325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026d1a4-40c2-4510-a218-e99bd2ebcdcc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:24.892084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 560/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:24 2022] GET /identity/v3/role_assignments?user.id=fff966e741314bb8b510713bff46a08c&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=7c6a107ae284453986ae63893fd8002c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:25.763803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532461a-0dfc-4c3e-9a18-fcd2df03d842 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:25.764325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532461a-0dfc-4c3e-9a18-fcd2df03d842 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:25.764325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532461a-0dfc-4c3e-9a18-fcd2df03d842 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:25.765659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 547/1107] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:25.771265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:25.771701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:25.771853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:25.789893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:25.791076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:25.829908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:25.863957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 561/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:25.888412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532461a-0dfc-4c3e-9a18-fcd2df03d842 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:25.953439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:25.987515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532461a-0dfc-4c3e-9a18-fcd2df03d842 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:26.021553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:26.022109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:26.022387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:26.022654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:26.023798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:26.025234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee90e65-a7b1-4c70-bec0-eacdf78335cb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:26.026781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 548/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:26.032837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:26.133383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad68ce-f0f8-4025-9cef-2d5ccf199e66 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:26.168989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:26.169596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:26.169873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:26.170142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:26.170831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:26.172286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8b2dd-2095-44b0-bba1-3e050f03885d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:26.193594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 562/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:47:26 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:28.213062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b7ee-0f56-4ac1-bfc3-19b30b237aae None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:28.213602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b7ee-0f56-4ac1-bfc3-19b30b237aae None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:28.213602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b7ee-0f56-4ac1-bfc3-19b30b237aae None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:28.215007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 549/1111] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:28.220336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:28.220741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:28.220893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:28.239126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:28.240345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:28.266940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:28.309576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 563/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:28.334381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49b7ee-0f56-4ac1-bfc3-19b30b237aae None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:28.437259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49b7ee-0f56-4ac1-bfc3-19b30b237aae None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:28.472485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:28.473186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:28.473471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:28.473762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] PATH_INFO: `/v3/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:28.475278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] RBAC: Authorizing `identity:get_role(role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:28.476800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:28.478216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 550/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:28 2022] GET /identity/v3/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:28.484394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:28.579618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd1a2b-a0ad-41a8-83e3-deb8b84bc732 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:28.613218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:28.614422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:28.614703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:28.614977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] PATH_INFO: `/v3/users/55a0497be8af409bb92d52d611aaee5b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:28.627871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] RBAC: Authorizing `identity:get_user(user_id=55a0497be8af409bb92d52d611aaee5b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:28.629365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:28.631202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 564/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:28 2022] GET /identity/v3/users/55a0497be8af409bb92d52d611aaee5b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:28.637101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:28.640074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:28.737319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1c68-5e48-4485-b539-ee20e3b4fcf5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:28.770533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:28.771139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:28.771414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:28.771687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:28.837421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:28.838885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:28.840833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:28.937584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 551/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:28.943616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:28.962782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:29.042651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a17d66-4fe9-4a9c-824e-39a7e902e32a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:29.074823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:29.075449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:29.075734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:29.076105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:29.077253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:29.078677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aabf0b-b99b-471c-9d7d-8a4b3d1707c1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:29.080358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 565/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:28 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:29.087044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:29.184210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdd8a-047e-4022-838d-363053f7d318 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:29.185740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:29.218428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:29.219068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:29.219353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:29.219629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:29.220444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05, user.id=55a0497be8af409bb92d52d611aaee5b) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:29.220756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:29.222187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac221bc1-0120-45a6-9a29-74c919ea4059 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:29.228034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 552/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:29 2022] GET /identity/v3/role_assignments?user.id=55a0497be8af409bb92d52d611aaee5b&scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:31.179361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d7d3-d015-47a5-bf8a-61f388241e11 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.179927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d7d3-d015-47a5-bf8a-61f388241e11 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.179927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d7d3-d015-47a5-bf8a-61f388241e11 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.181299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 566/1118] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:31.186544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.186920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.187105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.204795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:31.206011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:31.270603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 553/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:31.292841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d7d3-d015-47a5-bf8a-61f388241e11 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:31.374712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:31.390442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d7d3-d015-47a5-bf8a-61f388241e11 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:31.422603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:31.423224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.423500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.423790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] PATH_INFO: `/v3/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.425206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] RBAC: Authorizing `identity:get_role(role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:31.427087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:31.428460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 567/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:31 2022] GET /identity/v3/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:47:31.434843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:31.529750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:31.536394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109739f-a108-44a2-9725-ac09e85dd8b8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:31.569884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:31.570521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.570802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.571079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] PATH_INFO: `/v3/users/55a0497be8af409bb92d52d611aaee5b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.572256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=55a0497be8af409bb92d52d611aaee5b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:31.573701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:31.575313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 554/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:31 2022] GET /identity/v3/users/55a0497be8af409bb92d52d611aaee5b => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:31.581191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:31.678418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b76e-366b-481e-9c48-63feeb3ad018 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:31.711171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14edda1-143b-455b-8758-c27177650537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:31.711732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edda1-143b-455b-8758-c27177650537 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.712046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edda1-143b-455b-8758-c27177650537 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.712325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edda1-143b-455b-8758-c27177650537 None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.713469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14edda1-143b-455b-8758-c27177650537 None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:31.714901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14edda1-143b-455b-8758-c27177650537 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:31.716698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 568/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:31 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:31.722567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:31.821060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f3d-b66d-41c6-81a8-4426e9f4f3d0 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:31.854034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:31.854690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:31.854971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:31.855254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05/users/55a0497be8af409bb92d52d611aaee5b/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:31.857433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] RBAC: Authorizing `identity:create_grant(project_id=dab69d5a66c34fa8b1acc629fe1f6d05, user_id=55a0497be8af409bb92d52d611aaee5b, role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:31.858869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335acb5c-a6b3-4ccd-a777-7c00076e40be None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:31.872073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 555/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:47:31 2022] PUT /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05/users/55a0497be8af409bb92d52d611aaee5b/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:47:33.848205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c0f7-ffa8-41ba-9756-5173ebd92bc9 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:33.848741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c0f7-ffa8-41ba-9756-5173ebd92bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:33.848741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c0f7-ffa8-41ba-9756-5173ebd92bc9 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:33.850040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 569/1124] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:33.855282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:33.855727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:33.855875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:33.873675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:33.874859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:33.892106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:33.943131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 556/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:33.966507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c0f7-ffa8-41ba-9756-5173ebd92bc9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:33.990460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:34.064392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c0f7-ffa8-41ba-9756-5173ebd92bc9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:34.096872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:34.097524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:34.097804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:34.098079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] PATH_INFO: `/v3/roles/1118d4655bc44b768e08605e3bdb1f78` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:34.099558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] RBAC: Authorizing `identity:get_role(role_id=1118d4655bc44b768e08605e3bdb1f78)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:34.100907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:34.102225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 570/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:33 2022] GET /identity/v3/roles/1118d4655bc44b768e08605e3bdb1f78 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:34.107951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:34.208783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1abc-50cd-44f0-9101-2ef5463b941a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:34.241322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:34.241980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:34.242262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:34.242536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] PATH_INFO: `/v3/users/55a0497be8af409bb92d52d611aaee5b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:34.243694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] RBAC: Authorizing `identity:get_user(user_id=55a0497be8af409bb92d52d611aaee5b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:34.245162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:34.246763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 557/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:34 2022] GET /identity/v3/users/55a0497be8af409bb92d52d611aaee5b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:34.252589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:34.339702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:34.349466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0d02a-0ee7-4737-89fd-dd77fb3dc0fe None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:34.382398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:34.382952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:34.383237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:34.383512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:34.448074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:34.449531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:34.539923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:34.550141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 571/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:34.556595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:34.580012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:34.653298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19fa7e-9b9e-4fe2-ab68-5847c71c8a8c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:34.686566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:34.687201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:34.687483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:34.687779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] PATH_INFO: `/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:34.688926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] RBAC: Authorizing `identity:get_project(project_id=dab69d5a66c34fa8b1acc629fe1f6d05)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:34.690366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec21f91-ff13-4090-9ea5-3d1fd1723d04 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:34.692069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 558/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:34 2022] GET /identity/v3/projects/dab69d5a66c34fa8b1acc629fe1f6d05 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:34.698184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:34.792826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b30ef-46d3-4f86-9d20-d2668b3e4a93 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:34.825437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:34.826039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:34.826324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:34.826602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:34.827387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] RBAC: Adding query filter params (role.id=1118d4655bc44b768e08605e3bdb1f78, scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05, user.id=55a0497be8af409bb92d52d611aaee5b) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:34.827699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:34.829146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec12e94-7c34-4e7f-8cd0-e1477a2042c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:34.835643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 572/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:34 2022] GET /identity/v3/role_assignments?user.id=55a0497be8af409bb92d52d611aaee5b&scope.project.id=dab69d5a66c34fa8b1acc629fe1f6d05&role.id=1118d4655bc44b768e08605e3bdb1f78 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:36.860865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a5a0-b88a-44e3-b050-60df60ef0ec6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:36.861401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a5a0-b88a-44e3-b050-60df60ef0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:36.861401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a5a0-b88a-44e3-b050-60df60ef0ec6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:36.862695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 559/1131] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:36.868094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:36.868496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:36.868641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:36.886608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:36.887800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:36.935346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:36.952574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 573/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:36.976252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a5a0-b88a-44e3-b050-60df60ef0ec6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:37.065825 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:37.076438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a5a0-b88a-44e3-b050-60df60ef0ec6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:37.109386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:37.110017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:37.110298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:37.110572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:37.111788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:37.113749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b058909-5274-4b49-820d-b4327d2d10e7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:37.115323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 560/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:37.121085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:37.215445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35e06-4e99-4cad-8f3c-f880699b1c11 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:37.247707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:37.248335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:37.248615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:37.248888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:37.249573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:37.250993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a99b7e-d7db-4bae-b613-a78ce220d1d8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:37.276533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 574/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:47:37 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:39.315309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16442a-c6a3-47c9-a8af-3a66a416d940 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:39.315904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16442a-c6a3-47c9-a8af-3a66a416d940 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:39.315994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16442a-c6a3-47c9-a8af-3a66a416d940 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:39.317366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 561/1135] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:39.322700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:39.323132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:39.323239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:39.340851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:39.342026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:39.370357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:39.408753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 575/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:39.432967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16442a-c6a3-47c9-a8af-3a66a416d940 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:39.531487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16442a-c6a3-47c9-a8af-3a66a416d940 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:39.564090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:39.564709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:39.564986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:39.565259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:39.566982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:39.568386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3463ad-ad0a-4689-aca4-a875b7c7020d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:39.569961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 562/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:47:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:39.575735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:39.673472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727aa94-2f1b-45f4-b594-cd47fe5add7e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:39.710073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:39.710686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:39.710960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:39.711231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:39.711942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:39.713358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14345fc0-7c3f-4d60-9817-dddb8c0f283c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:39.733412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 576/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:47:39 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:41.747824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6763d-4dc8-430c-b458-58cf4aab31e1 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:41.748346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6763d-4dc8-430c-b458-58cf4aab31e1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:41.748346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6763d-4dc8-430c-b458-58cf4aab31e1 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:41.749726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 563/1139] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:41.755516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:41.756292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:41.756491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:41.775138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:41.776368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:41.793381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:41.844752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 577/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 20:47:41.868509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6763d-4dc8-430c-b458-58cf4aab31e1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:41.895929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:41.969790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6763d-4dc8-430c-b458-58cf4aab31e1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.006842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.007405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.007687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.007996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.018245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:42.023153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:42.024396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:42.025671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 564/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:42.031461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:42.127474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ee934-8f07-4dc5-aac1-5f0d67cb6f01 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.160514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.161119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.161405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.161675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.162383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:42.162688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:42.164080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:42.171948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 578/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:42.178356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:42.267645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:42.282935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb0aff-24ae-41f2-82f0-2951af7a97ad None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.318110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.318747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.319031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.319309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] PATH_INFO: `/v3/users/d315c846aada44f08944c4422ac07152` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.332333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] RBAC: Authorizing `identity:get_user(user_id=d315c846aada44f08944c4422ac07152)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:42.333779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:42.335425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 565/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:42 2022] GET /identity/v3/users/d315c846aada44f08944c4422ac07152 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:42.341246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:42.357612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:42.439429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c803c-cd8f-457f-8b03-f493fb10797c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.474811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.475526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.475891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.476222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.550298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:42.551931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:42.567569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:42.660937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 579/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:42.666865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:42.764072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e560ad-e5a0-4504-97be-a0f7d1af6f70 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.798354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.798992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.799282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.799614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] PATH_INFO: `/v3/projects/b367a1689ad54ea997666e1a8d75ea01` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.800946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] RBAC: Authorizing `identity:get_project(project_id=b367a1689ad54ea997666e1a8d75ea01)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:42.802323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781fbb3-a64a-4cc5-a0ca-1bafd1f7821a None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:42.804029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 566/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:42 2022] GET /identity/v3/projects/b367a1689ad54ea997666e1a8d75ea01 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:42.810391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:42.914177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fff0c-62f2-42ff-985e-3d5efb2364f4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:42.928537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:42.948874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:42.949488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:42.949770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:42.950203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:42.950990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=b367a1689ad54ea997666e1a8d75ea01, user.id=d315c846aada44f08944c4422ac07152) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:42.951303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:42.952756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119e514-3477-49a8-b939-fff3bda0c8c6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:42.958803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 580/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:42 2022] GET /identity/v3/role_assignments?user.id=d315c846aada44f08944c4422ac07152&scope.project.id=b367a1689ad54ea997666e1a8d75ea01&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:45.224134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06adb8-f363-4e3e-bdcd-0ef634158f64 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.224673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06adb8-f363-4e3e-bdcd-0ef634158f64 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.224673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06adb8-f363-4e3e-bdcd-0ef634158f64 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.226061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 567/1147] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:45.231457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.231925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.232136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.252012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:45.253894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:45.328561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 581/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:45.350800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06adb8-f363-4e3e-bdcd-0ef634158f64 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:45.365528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:45.452868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06adb8-f363-4e3e-bdcd-0ef634158f64 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:45.486946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:45.487551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.487873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.488151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.497979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:45.502947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:45.504144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:45.505393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 568/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:45.510177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:45.604442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37470f-1f19-4079-b16c-fdbd3d47c6bb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:45.613174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:45.636894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:45.637490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.637766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.638038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.638733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:45.639036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:45.640418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:45.648597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 582/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:45.654452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:45.725025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:45.753982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a2a33-94d1-4d17-a0d5-b429b83e4ced None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:45.787465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:45.788126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.788411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.788688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] PATH_INFO: `/v3/users/d315c846aada44f08944c4422ac07152` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.789845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] RBAC: Authorizing `identity:get_user(user_id=d315c846aada44f08944c4422ac07152)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:45.791280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:45.792913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 569/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:45 2022] GET /identity/v3/users/d315c846aada44f08944c4422ac07152 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:45.798839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:45.894360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31629e9f-54ff-46fe-8059-29fccc5d5b30 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:45.926108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:45.926734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:45.927017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:45.927294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] PATH_INFO: `/v3/projects/b367a1689ad54ea997666e1a8d75ea01` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:45.928457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] RBAC: Authorizing `identity:get_project(project_id=b367a1689ad54ea997666e1a8d75ea01)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:45.929886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495af3f-603e-47c0-902e-4a0204bdd8cc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:45.931522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 583/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:45 2022] GET /identity/v3/projects/b367a1689ad54ea997666e1a8d75ea01 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:45.937499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:46.041935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f7d7-25b6-42a1-9e76-3ce6dfc51728 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:46.074772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:46.075425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:46.075707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:46.076011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] PATH_INFO: `/v3/projects/b367a1689ad54ea997666e1a8d75ea01/users/d315c846aada44f08944c4422ac07152/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:46.077939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] RBAC: Authorizing `identity:create_grant(project_id=b367a1689ad54ea997666e1a8d75ea01, user_id=d315c846aada44f08944c4422ac07152, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:46.079373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ad790-c0fa-4022-a393-93add8050741 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:46.089195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:46.093854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 570/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:47:45 2022] PUT /identity/v3/projects/b367a1689ad54ea997666e1a8d75ea01/users/d315c846aada44f08944c4422ac07152/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:47:48.064576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229910d9-7e4d-4a60-9a95-e70faf9e6f78 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.065664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229910d9-7e4d-4a60-9a95-e70faf9e6f78 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.065664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229910d9-7e4d-4a60-9a95-e70faf9e6f78 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.066973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 584/1154] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:48.072160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.072613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.072708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.091122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:48.092339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:48.157832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 571/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:48.181314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229910d9-7e4d-4a60-9a95-e70faf9e6f78 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:48.221473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:48.282812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229910d9-7e4d-4a60-9a95-e70faf9e6f78 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:48.314963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:48.316072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.316351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.316619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.326368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:47:48.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:48.332968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:47:48.334264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 585/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:48.339022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:48.435754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deba27-2e35-4d46-bc4b-ad2c04843b20 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:48.464251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:48.469974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:48.470596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.470876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.471151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.471909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:48.472218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:48.473598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:48.481618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 572/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:47:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:48.487986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:48.581255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:48.584963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3ff6b-dce4-43a2-90e8-fc0e71a0487d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:48.617792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:48.618411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.618692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.618959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] PATH_INFO: `/v3/users/d315c846aada44f08944c4422ac07152` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.620121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] RBAC: Authorizing `identity:get_user(user_id=d315c846aada44f08944c4422ac07152)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:48.621606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:48.623164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 586/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:47:48 2022] GET /identity/v3/users/d315c846aada44f08944c4422ac07152 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:48.629396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:48.724602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b89f3-f784-43eb-a926-aa9c57a5d14d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:48.757149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:48.757748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:48.758030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:48.758302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:48.813401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:48.823882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:48.825345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:48.920521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 573/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:48.926567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:49.023423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25936d-b520-43b3-bf48-b76864b676f6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:49.054939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:49.055563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:49.055871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:49.056148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] PATH_INFO: `/v3/projects/b367a1689ad54ea997666e1a8d75ea01` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:49.057288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] RBAC: Authorizing `identity:get_project(project_id=b367a1689ad54ea997666e1a8d75ea01)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:49.058705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c1e6-fc4a-482a-b3a3-0dd7841c75bc None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:49.060373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 587/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:47:48 2022] GET /identity/v3/projects/b367a1689ad54ea997666e1a8d75ea01 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:49.067057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:49.153659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:49.162879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b9b7-fbe1-4cdc-9069-9b0b89d1b15c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:49.195590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:49.196174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:49.196460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:49.196737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:49.197521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=b367a1689ad54ea997666e1a8d75ea01, user.id=d315c846aada44f08944c4422ac07152) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:49.197837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:49.199302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82f611-b942-4f2d-a45d-65baefbcb819 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:49.205048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 574/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:47:49 2022] GET /identity/v3/role_assignments?user.id=d315c846aada44f08944c4422ac07152&scope.project.id=b367a1689ad54ea997666e1a8d75ea01&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:51.199474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f334-96cd-498d-ab7c-f2b141418a15 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:51.200052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f334-96cd-498d-ab7c-f2b141418a15 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:51.200052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7f334-96cd-498d-ab7c-f2b141418a15 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:51.201417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 588/1162] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:51.206545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:51.206961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:51.207100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:51.225156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:51.226332 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:51.290993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 575/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:51.313350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7f334-96cd-498d-ab7c-f2b141418a15 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:51.348178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:51.413500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7f334-96cd-498d-ab7c-f2b141418a15 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:51.445791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:51.446400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:51.446685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:51.446960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:51.516082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:51.517526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:51.552885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:51.619439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 589/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:47:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:47:51.625375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:51.706431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:51.721149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92961-a410-47c2-8e14-932fa2caecd2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:51.754482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:51.755107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:51.755390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:51.755667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:51.762364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:51.763960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c5b4e8f1-cdfd-4739-bd9e-aee47f189e62 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:47:51.775285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:47:51.776562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:47:51.777665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 576/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:47:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:47:51.782581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:51.878107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582ddbf-327e-445e-9933-7f6dcaacc034 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:51.912549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:51.913159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:51.913441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:51.913711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:51.914396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:47:51.914698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:51.916107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a43b4a-f26d-4f36-b4db-3c166fa37124 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:51.917513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:51.923960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 590/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 4 20:47:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:53.894471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840900ef-b7e5-4789-bd3a-5fb2673bcfe0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:53.895033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840900ef-b7e5-4789-bd3a-5fb2673bcfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:53.895033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840900ef-b7e5-4789-bd3a-5fb2673bcfe0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:53.896418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 577/1167] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:53.901741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb7a6-851d-4c75-8104-9347b0623a46 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:53.902158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb7a6-851d-4c75-8104-9347b0623a46 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:53.902306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb7a6-851d-4c75-8104-9347b0623a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:53.920706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ba6eb7a6-851d-4c75-8104-9347b0623a46 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:53.921888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba6eb7a6-851d-4c75-8104-9347b0623a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:53.990801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 591/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:54.013635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840900ef-b7e5-4789-bd3a-5fb2673bcfe0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:54.114947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840900ef-b7e5-4789-bd3a-5fb2673bcfe0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:54.147305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:54.147889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:54.148173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:54.148448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:54.149164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:54.150532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061cf6-91c3-4264-967e-0782cb79395d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:54.166868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 578/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu Aug 4 20:47:54 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:56.176215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d13-0e90-4713-b0e4-53d962a5cf6f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:56.176761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d13-0e90-4713-b0e4-53d962a5cf6f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:56.176761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b9d13-0e90-4713-b0e4-53d962a5cf6f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:56.178131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 592/1170] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:56.183288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:56.183787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:56.183888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:56.197116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:56.202657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:56.204182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:56.270078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 579/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:56.293904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b9d13-0e90-4713-b0e4-53d962a5cf6f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:56.398943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b9d13-0e90-4713-b0e4-53d962a5cf6f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:56.424716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:56.433106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:56.433674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:56.433950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:56.434221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] PATH_INFO: `/v3/domains/2859d95157e2429786644f3ef3420bbc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:56.444728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=2859d95157e2429786644f3ef3420bbc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:56.446151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a6f39-c6de-4361-83de-3c463367c54e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:56.447735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 593/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Aug 4 20:47:56 2022] GET /identity/v3/domains/2859d95157e2429786644f3ef3420bbc => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:56.453734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:56.549764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414cc0-7a3e-45af-b51b-9e6bcb64ceac None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:56.582822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:56.583435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:56.583718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:56.584027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:56.584708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:56.586145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0040-3e95-4c81-ade4-42ab2095a604 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:56.591329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:56.611846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 580/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:47:56 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:47:58.626558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f70c8-7777-437d-a90d-659fb03aab43 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:58.627609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f70c8-7777-437d-a90d-659fb03aab43 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:58.627723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f70c8-7777-437d-a90d-659fb03aab43 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:58.629084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 594/1174] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:47:58.634355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:58.634746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:58.634910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:58.653252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:47:58.654426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:47:58.719323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 581/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:47:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:47:58.743337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f70c8-7777-437d-a90d-659fb03aab43 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:58.841179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f70c8-7777-437d-a90d-659fb03aab43 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:58.875628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:58.876280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:58.876562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:58.877329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] PATH_INFO: `/v3/domains/2859d95157e2429786644f3ef3420bbc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:58.878493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=2859d95157e2429786644f3ef3420bbc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:58.880729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f163dc-c5ec-4e54-ac4e-bc5a14fbe7da None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:58.881534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 595/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Aug 4 20:47:58 2022] GET /identity/v3/domains/2859d95157e2429786644f3ef3420bbc => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:47:58.887895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:47:58.985167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5108a3-7c15-472a-a06e-6177f989c63b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:47:59.002722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:47:59.019557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:47:59.020199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:47:59.020483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:47:59.020756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:47:59.021433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:47:59.022877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea410618-3c67-4187-b8f0-ac9c460f9f3f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:47:59.043799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 582/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:47:58 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:48:01.057818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56b6d-0dc1-4e41-989a-4c0684effd2e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.058381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56b6d-0dc1-4e41-989a-4c0684effd2e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.058381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56b6d-0dc1-4e41-989a-4c0684effd2e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.059725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 596/1178] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:48:01.064775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.065190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.065338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.083127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:48:01.084354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:48:01.162424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 583/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:48:01.186553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba56b6d-0dc1-4e41-989a-4c0684effd2e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:01.243398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:01.287218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba56b6d-0dc1-4e41-989a-4c0684effd2e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:01.319304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:01.319899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.320178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.320448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.330651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:48:01.335510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:48:01.336655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:48:01.337540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 597/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:48:01.342754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:01.438662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec76eca-bf4a-49be-b397-7ccc16437728 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:01.441022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:01.475257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:01.475920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.476207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.476482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.477197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:48:01.477502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:01.478876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:01.486875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 584/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:48:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:01.492639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:01.591116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ceb239-6fdd-4f27-8025-1f00f47a89ab None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:01.608536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:01.627241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:01.627908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.628196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.628475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] PATH_INFO: `/v3/users/aa6ee3a5071e4826b20f5cd282acc673` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.641534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6ee3a5071e4826b20f5cd282acc673)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:01.643566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:01.645597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 598/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:48:01 2022] GET /identity/v3/users/aa6ee3a5071e4826b20f5cd282acc673 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:01.651554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:01.747842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d786c-80ed-4b97-9dae-db770d89492f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:01.780508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:01.781106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:01.781386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:01.781657 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:01.813021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:01.846973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:01.848381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:01.943005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 585/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:48:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:48:01.948888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:02.048424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2613-8c01-4993-ad7b-12dadd29cf65 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:02.083204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:02.083946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:02.084258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:02.084574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] PATH_INFO: `/v3/projects/8865310a0784478eb6f5c2f314b52269` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:02.085781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] RBAC: Authorizing `identity:get_project(project_id=8865310a0784478eb6f5c2f314b52269)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:02.087294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dbb48-62fb-43bc-ac72-522931403590 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:02.088987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 599/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:48:01 2022] GET /identity/v3/projects/8865310a0784478eb6f5c2f314b52269 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:02.095029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:02.157807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:02.192116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06fc3b-22e2-4cd6-b970-00e4310c10b5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:02.225463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:02.226074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:02.226353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:02.226627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:02.227404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=8865310a0784478eb6f5c2f314b52269, user.id=aa6ee3a5071e4826b20f5cd282acc673) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:48:02.227712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:02.229163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c291e-e386-41e9-b898-1d7f7250b13f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:02.234431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 586/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:48:02 2022] GET /identity/v3/role_assignments?user.id=aa6ee3a5071e4826b20f5cd282acc673&scope.project.id=8865310a0784478eb6f5c2f314b52269&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:04.209234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42273b4b-5b53-4ba7-8163-d89761ad4c90 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.209841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42273b4b-5b53-4ba7-8163-d89761ad4c90 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.209841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42273b4b-5b53-4ba7-8163-d89761ad4c90 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.211150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 600/1186] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:48:04.216168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.216624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.216721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.234967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:48:04.236206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:48:04.301393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 587/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:48:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:48:04.323765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42273b4b-5b53-4ba7-8163-d89761ad4c90 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:04.368399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:04.424612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42273b4b-5b53-4ba7-8163-d89761ad4c90 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:04.457227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:04.457860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.458138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.458410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.468286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:48:04.473693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:48:04.474932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:48:04.476088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 601/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:48:04.481067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:04.539232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:04.577997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb315bf6-2204-4c06-870b-78c200633d9c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:04.610530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:04.611137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.611419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.611695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.612436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:48:04.612742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:04.614110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:04.621915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 588/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:48:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:04.628227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:04.725360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82edb1-84a1-4cc7-9c4c-e0cf17ff0e08 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:04.726774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:04.760169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:04.760798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.761081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.761356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] PATH_INFO: `/v3/users/aa6ee3a5071e4826b20f5cd282acc673` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.762509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6ee3a5071e4826b20f5cd282acc673)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:04.763963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:04.765545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 602/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:48:04 2022] GET /identity/v3/users/aa6ee3a5071e4826b20f5cd282acc673 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:04.771885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:04.867835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150bef-a27b-4262-ad7e-145b2f4ea35f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:04.889453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:04.902001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:04.902652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:04.902938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:04.903219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] PATH_INFO: `/v3/projects/8865310a0784478eb6f5c2f314b52269` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:04.904444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] RBAC: Authorizing `identity:get_project(project_id=8865310a0784478eb6f5c2f314b52269)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:04.906188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f82629-a25e-46d4-abd2-8c77e238bfa2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:04.907915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 589/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:48:04 2022] GET /identity/v3/projects/8865310a0784478eb6f5c2f314b52269 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:04.913898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:05.015166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc3ca-b164-407d-8daf-8f270ad9ede9 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:05.049410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:05.050075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:05.050357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:05.050633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] PATH_INFO: `/v3/projects/8865310a0784478eb6f5c2f314b52269/users/aa6ee3a5071e4826b20f5cd282acc673/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:05.052585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] RBAC: Authorizing `identity:create_grant(project_id=8865310a0784478eb6f5c2f314b52269, user_id=aa6ee3a5071e4826b20f5cd282acc673, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:05.054008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a1943-1c1c-4bb6-a7b4-e59f50c31b64 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:05.067145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 603/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:48:04 2022] PUT /identity/v3/projects/8865310a0784478eb6f5c2f314b52269/users/aa6ee3a5071e4826b20f5cd282acc673/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:48:07.020148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05157-f8f7-48b7-9978-374a59503494 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.020711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05157-f8f7-48b7-9978-374a59503494 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.020711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca05157-f8f7-48b7-9978-374a59503494 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.022072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 590/1193] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:48:07.027232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.027636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.027822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.046189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:48:07.047369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:48:07.070527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:07.114510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 604/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:48:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:48:07.138485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca05157-f8f7-48b7-9978-374a59503494 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:07.239915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca05157-f8f7-48b7-9978-374a59503494 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:07.274219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:07.274843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.275128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.275399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.286173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:48:07.291087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:48:07.292271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:48:07.293297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 591/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:48:07.298314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:07.391034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d861b10-beb0-49b2-a6c0-d130a15b18e9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:07.424123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:07.424723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.425002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.425276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.425981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:48:07.426285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:07.427646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:07.435359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 605/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:07.441064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:07.490999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:07.539587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3bb2-bed0-4648-b245-2d1ca9a0eef1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:07.572158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:07.572788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.573072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.573346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] PATH_INFO: `/v3/users/aa6ee3a5071e4826b20f5cd282acc673` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.574500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6ee3a5071e4826b20f5cd282acc673)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:07.575962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:07.577550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 592/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 4 20:48:07 2022] GET /identity/v3/users/aa6ee3a5071e4826b20f5cd282acc673 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:07.583839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:07.607550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:07.680723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674eea-f24f-4e48-b9c7-ca93e7a4d35d None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:07.713303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:07.713910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:07.714196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:07.714469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:07.778284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:07.780064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:07.801740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:07.874341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 606/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 20:48:07.881033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:07.976042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a31d7-81ed-45cf-8993-200b2a06b9b4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:07.993058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:08.009916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:08.010545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:08.010828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:08.011102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] PATH_INFO: `/v3/projects/8865310a0784478eb6f5c2f314b52269` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:08.012257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] RBAC: Authorizing `identity:get_project(project_id=8865310a0784478eb6f5c2f314b52269)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:08.013690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a343884-3470-422d-bf1a-c6047631ce95 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:08.015337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 593/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 4 20:48:07 2022] GET /identity/v3/projects/8865310a0784478eb6f5c2f314b52269 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:08.021428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:48:08.117282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487e542-a809-4ff5-8784-c59b068b4bed None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:48:08.139560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:08.151465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:48:08.152116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:48:08.152398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:48:08.152676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:48:08.153462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=8865310a0784478eb6f5c2f314b52269, user.id=aa6ee3a5071e4826b20f5cd282acc673) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:48:08.153776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:48:08.155490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399eef1-34ca-47c1-89bd-b00dc1bde51d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:48:08.161172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 607/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:48:08 2022] GET /identity/v3/role_assignments?user.id=aa6ee3a5071e4826b20f5cd282acc673&scope.project.id=8865310a0784478eb6f5c2f314b52269&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:48:18.005905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:48:18.158586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:02.717459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef1c8-ac7b-4137-bf83-8cf04b15bfaf None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:02.718016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef1c8-ac7b-4137-bf83-8cf04b15bfaf None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:02.718016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccef1c8-ac7b-4137-bf83-8cf04b15bfaf None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:02.719440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 594/1201] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:02.725377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:02.725878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:02.726177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:02.745635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:02.746901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:02.826814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 608/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:02.853877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef1c8-ac7b-4137-bf83-8cf04b15bfaf None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:02.980400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccef1c8-ac7b-4137-bf83-8cf04b15bfaf None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:03.025174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:03.025859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:03.026147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:03.026430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:03.042423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:03.042423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:03.059699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:03.064693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:03.066023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:03.066023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:03.066023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:03.066023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:03.066023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 595/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:03.067801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:03.192513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d68e49-1a0b-4b98-91e7-68fc059ce409 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:03.227550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:03.235075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:03.235659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:03.236282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:03.236500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:03.237298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:03.237629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:03.239251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10128f9-6e8c-4f35-b463-90bd17e22f7e None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:03.253022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 609/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:03.258565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:03.326192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:03.395246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a40ec4-1bdb-4567-9472-28cb3d993b0f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:03.443442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:03.444472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:03.444729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:03.444982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:03.445814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:03.447887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32ea97-7760-4ca3-961d-cd93d49bb1d5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:03.476628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 596/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 4 20:49:03 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:49:05.866144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547089b-39d1-4a72-a5f1-d8155aa8b16b None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:05.866733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547089b-39d1-4a72-a5f1-d8155aa8b16b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:05.866733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547089b-39d1-4a72-a5f1-d8155aa8b16b None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:05.868465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 610/1206] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:05.875650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:05.876198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:05.876302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:05.895480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:05.896827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:05.971245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 597/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:05.996861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547089b-39d1-4a72-a5f1-d8155aa8b16b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:06.109121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547089b-39d1-4a72-a5f1-d8155aa8b16b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:06.152724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:06.153923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:06.154293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:06.154653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:06.167317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:06.174307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:06.175593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:06.176668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 611/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:49:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:06.184816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:06.235047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:06.304608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf302816-f553-43d4-ba73-2ce359562beb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:06.341729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:06.342429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:06.342714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:06.343005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:06.343704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:06.344030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:06.345472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:06.354665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 598/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:49:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:06.360222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:06.414138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:06.475134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d146ad0-d4ec-47f7-a387-50641bbf0f14 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:06.516500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:06.517492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:06.517780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:06.518054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:06.529555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:06.531103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:06.547762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:06.548899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:06.550016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:06.550016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:06.550016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:06.550016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:06.550016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 612/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:49:06.554851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:06.678415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:06.682282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57752efa-b2f3-43ea-b4bd-a08cb0b599e1 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:06.724032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:06.724805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:06.725119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:06.725452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:06.726104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:06.726426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:06.728035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:06.745684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 599/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:06.749318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:06.892463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4bca4-4833-4239-b2c9-830a20878325 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:06.894887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:06.937749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:06.938313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:06.938595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:06.938867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:06.947202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:06.948751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:06.961399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:06.962842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:06.964139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 613/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:06.970968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:07.086995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a283123-54b8-4f46-b16c-fd1127cc8437 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:07.135704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:07.136599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:07.136986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:07.137493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:07.139124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:07.139629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:07.141497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:07.172912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 600/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:07.174407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:07.303007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce31786-47ec-41dd-971a-b70130ff9f43 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:07.347058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:07.347689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:07.348014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:07.348292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:07.382736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:07.426809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:07.428455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:07.546102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 614/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:49:07.552638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:07.574843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:07.678473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8398-c564-46ca-95d2-fe919f822e57 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:07.719094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:07.719758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:07.720065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:07.720339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:07.732935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:07.734638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:07.753433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:07.755734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:07.756720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:07.756720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:07.756720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:07.756720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:07.756720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 601/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:07.760561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:07.832929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:07.886090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad005e61-141d-4531-a54b-504be5b5d1d2 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:07.929232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:07.930148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:07.930321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:07.930583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:07.931389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:07.931697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:07.933914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:07.955863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 615/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:07.958012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:08.037935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:08.072347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e90de-ebaf-446d-b33a-1b5c5c8f2328 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:08.114688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:08.115275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:08.115550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:08.115846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:08.122751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:08.124230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:08.135836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:08.136848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:08.138365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:08.142607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 602/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:08.143640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:08.261072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769529b-e533-408b-89ca-78b7fc639175 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:08.291924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:08.307229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:08.307229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:08.307229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:08.307229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:08.307996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:08.308229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:08.310289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d0e8-019d-45ba-b4f5-e88a1af87c92 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:08.330189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 616/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:08.332647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:08.471349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd83e-0072-4bc7-aeb5-0b5098de9bff None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:08.504912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:08.513472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:08.514338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:08.514617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:08.514982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:08.515797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a01a4b3ff4334746912df78fae4e2fbe) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:08.516114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:08.517684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb7504-869d-4db3-9398-7d622a8e246c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:08.528728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 603/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:49:08 2022] GET /identity/v3/role_assignments?user.id=a01a4b3ff4334746912df78fae4e2fbe&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:10.589070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e478d-18ad-4472-ac12-32baa368b724 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:10.589685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e478d-18ad-4472-ac12-32baa368b724 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:10.589685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e478d-18ad-4472-ac12-32baa368b724 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:10.591507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 617/1220] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:49:10.597012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:10.597464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:10.597583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:10.617029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:10.618523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:10.692096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 604/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:10.714295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e478d-18ad-4472-ac12-32baa368b724 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:10.824145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e478d-18ad-4472-ac12-32baa368b724 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:10.858362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:10.859009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:10.859288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:10.859565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:10.869730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:10.875146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:10.876324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:10.877194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 618/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:49:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:10.882491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:10.994978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030bb9-5835-44ae-9c5f-3af0b778d80f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.022222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:11.035009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.035635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.035942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.036213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.037152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] RBAC: Adding query filter params (name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:11.037466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.038917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.048757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 605/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:49:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:11.054903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:11.099090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:11.164191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b357b3-f626-4b11-a3d0-0f817a6cfca6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.205216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.206000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.206308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.206628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.218351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.220120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:11.236376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:11.238838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:11.240029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:11.240029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:11.240029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:11.240029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:11.240029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 619/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:11.243282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:11.355042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5d552-b60a-4da7-9aea-cab4bea0c21e None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.388231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.388850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.389131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.389402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.390080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:11.390381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.391778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.406528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 606/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:11.412959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:11.517069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:11.524233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad749dcc-c4eb-49db-9a9a-8abbd26a71a1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.558999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.559668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.559986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.560269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.567663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.569149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:11.580286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:11.581465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:11.582488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 620/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:49:11.587650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:11.641195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:11.705723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a970cbd-145d-4398-8252-b4badf18deae None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.746109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.746761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.747045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.747372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.748395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:11.748710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.750483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.776116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 607/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:49:11.783505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:11.896973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ab63-7d3e-4d36-a9e2-de719c75fafd None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:11.934075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:11.934785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:11.935141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:11.935458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:11.946342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:11.947836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:11.964308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:11.965592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:11.966636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:11.966636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:11.966636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:11.966636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:11.966636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 621/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:11.971966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:12.078797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8fd6c-9549-494f-bc54-82ef787e164f None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:12.081291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:12.114003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:12.114635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:12.114921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:12.115198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:12.115930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:12.116237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:12.117612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:12.130027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 608/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:12.135961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:12.146535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:12.259357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401531b-bdd6-4eb7-9475-ef1ee53f0b39 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:12.298225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:12.298871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:12.299151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:12.299432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:12.306296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:12.307768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:12.320844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:12.322015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:12.323129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:12.330208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 622/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:12.331545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:12.446454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543f3f1-d0db-4ca4-bad3-0f1366153856 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:12.485267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:12.485919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:12.486203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:12.486485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:12.487235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:12.487565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:12.489024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af4a9a-284c-4f84-b4e3-793b1be1d870 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:12.502280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 609/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:12.509194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:12.576089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:12.613886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c77c88-e6c6-494a-a8fc-141d82ea5a73 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:12.651415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:12.652514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:12.652845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:12.653255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a01a4b3ff4334746912df78fae4e2fbe/roles/484a1bd75e544a4bb6977eb00ac66f8e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:12.669867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=a01a4b3ff4334746912df78fae4e2fbe, role_id=484a1bd75e544a4bb6977eb00ac66f8e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:12.671755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd31b93-df4d-4211-b042-8493f6e1f892 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:12.686061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 623/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:49:12 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a01a4b3ff4334746912df78fae4e2fbe/roles/484a1bd75e544a4bb6977eb00ac66f8e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:49:14.749584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b530c-b5fb-4e9f-bdd3-790e72312d91 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:14.750097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b530c-b5fb-4e9f-bdd3-790e72312d91 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:14.750097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b530c-b5fb-4e9f-bdd3-790e72312d91 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:14.751404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 610/1233] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:14.756504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:14.756899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:14.757060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:14.775610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:14.776852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:14.845187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 624/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:14.868843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b530c-b5fb-4e9f-bdd3-790e72312d91 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:14.896063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:14.977238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b530c-b5fb-4e9f-bdd3-790e72312d91 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.016419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.016991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.017275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.017549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.028552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:15.034329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:15.035434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:15.036349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 611/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 4 20:49:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:15.041913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:15.091635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:15.156230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5b6f-a0ba-44fb-93f6-fa5033896921 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.200814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.201433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.201715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.201986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.202697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:15.203000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:15.204519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:15.214251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 625/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:15.220641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:15.319422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:15.339190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbf1e-4366-40e5-b7e8-9a7a14fcb59a None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.376923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.377598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.377903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.378179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.390237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:15.391714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:15.407459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:15.408621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:15.409727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:15.409727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:15.409727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:15.409727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:15.409727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 612/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:15.414757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:15.520333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddddb51-ae87-471a-a59e-e636e80eef58 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.530357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:15.555516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.556174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.556455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.556725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.557413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:15.557719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:15.559251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:15.572253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 626/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:15.578697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:15.688999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556515a6-f041-4854-8ed0-afeef8effce2 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.725422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.726123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.726407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.726682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.729594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:15.737537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:15.738994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:15.752788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:15.754509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:15.755736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 613/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:15.763279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:15.877232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e974cd-ad72-4e5e-8b1f-398869c90d1b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:15.914939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:15.915555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:15.915876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:15.916155 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:15.916967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:15.917271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:15.918745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:15.937160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 627/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:15.943156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:16.061916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa83ca8-e5e0-498a-b19d-136403163fcd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:16.101617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:16.102337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:16.102673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:16.102949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:16.176339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:16.185198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:16.186700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:16.306877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 614/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:49:16.313217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:16.341542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:16.420890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba5af6-7d8d-4e3a-bd63-2ab18e17077b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:16.460445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2880-170c-448f-b826-fac14113880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:16.461026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2880-170c-448f-b826-fac14113880b None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:16.461703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2880-170c-448f-b826-fac14113880b None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:16.462522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a2880-170c-448f-b826-fac14113880b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:16.473943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a2880-170c-448f-b826-fac14113880b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:16.475446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a2880-170c-448f-b826-fac14113880b None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f94a2880-170c-448f-b826-fac14113880b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:16.493548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:16.494670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:16.495644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:16.495644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:16.495644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:16.495644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:16.495644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 628/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:16.501346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:16.609530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:16.616573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc1d2-08b3-4ff9-ac6f-5e475ad4b514 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:16.657886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:16.658517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:16.658797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:16.659067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:16.659868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:16.660175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:16.661641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:16.673756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 615/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:16.679937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2880-170c-448f-b826-fac14113880b None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:16.768834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:16.794061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a2880-170c-448f-b826-fac14113880b None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:16.833030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:16.833803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:16.834117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:16.834467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:16.842753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:16.844429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:16.857718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:16.858822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:16.859949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 629/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:49:16.864841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:16.979916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4d00e-1475-484e-af2a-41c03b82d853 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:17.020335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:17.020877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:17.021157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:17.021558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:17.022274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:17.022584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:17.024489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc582e9-92b9-4d81-9523-ef7e687ab242 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:17.045858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 616/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:49:17.047399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:17.156318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dbc99-00a4-4e33-8597-6f8ffdad3fd0 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:17.201306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:17.202343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:17.202726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:17.203070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:17.204206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] RBAC: Adding query filter params (role.id=484a1bd75e544a4bb6977eb00ac66f8e, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a01a4b3ff4334746912df78fae4e2fbe) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:17.204637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:17.206732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb06fbc-a19e-48ef-bc39-a69c0866609d None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:17.215042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 630/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:49:17 2022] GET /identity/v3/role_assignments?user.id=a01a4b3ff4334746912df78fae4e2fbe&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=484a1bd75e544a4bb6977eb00ac66f8e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:49:19.487437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff2fa-ef79-4328-8755-29a4c71afd88 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:19.488159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff2fa-ef79-4328-8755-29a4c71afd88 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:19.488159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff2fa-ef79-4328-8755-29a4c71afd88 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:19.489675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 617/1247] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:19.495144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:19.495672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:19.495891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:19.502547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:19.518033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:19.519335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:19.606401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 631/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:19.630659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff2fa-ef79-4328-8755-29a4c71afd88 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:19.653825 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:19.757304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff2fa-ef79-4328-8755-29a4c71afd88 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:19.798682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:19.799448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:19.799828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:19.800133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:19.811837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:19.817364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:19.818531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:19.819422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 618/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:19.825672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:19.931880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e70556-1303-4466-bc3b-f0717a4ff757 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:19.964183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:19.969790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:19.970410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:19.970690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:19.970969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:19.971676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:19.972013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:19.973370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:19.984798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 632/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:49:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:19.990584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:20.079419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:20.107848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628b98-cbc6-4485-8b80-71068e3913a4 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:20.149780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:20.150542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:20.150840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:20.151123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:20.164860 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:20.166503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:20.189651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:20.190773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:20.191734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:20.191734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:20.191734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:20.191734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:20.191734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 619/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:20.196920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:20.310318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdd22-af23-44dd-9be3-00cf3ba03705 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:20.348534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:20.349107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:20.349413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:20.349784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:20.350511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:20.350895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:20.352353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:20.368173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 633/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:20.374237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:20.492304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be178926-86ed-4d73-9f4b-06742b0c8a74 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:20.521389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:20.530706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:20.531407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:20.531699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:20.532014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:20.541845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:20.543976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:20.556685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:20.557806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:20.558818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 620/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:20.564011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:20.624064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:20.674273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906c336-2dfc-42b9-84c4-dce57be71f93 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:20.711215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:20.711882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:20.712167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:20.712443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:20.713238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:20.713544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:20.715550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:20.732884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 634/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:20.738767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:20.850448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2337b4-9e3e-4f6d-91e1-c4dcd03d7601 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:20.890887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:20.891441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:20.891713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:20.892010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:20.948869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:20.962134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:20.963790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.080982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 621/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:49:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:49:21.086120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:21.201523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a85d-8ddb-49cc-ade3-6f1431c37e94 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:21.215869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:21.242336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:21.243023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:21.243348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:21.243613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:21.254764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:21.256259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:21.271982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:21.273258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:21.274427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:21.274427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:21.274427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:21.274427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:21.274427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 635/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:21.280045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:21.379050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:21.391802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9a21-effc-49c3-b237-650b0a336421 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:21.427703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:21.428379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:21.428650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:21.428914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:21.429598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:21.429906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:21.431295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.442562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 622/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:21.448322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:21.564112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd6ee-cbf8-4a48-8b14-d888b7dd52e1 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:21.600833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:21.601489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:21.601768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:21.602039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:21.609177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:21.610741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:21.622453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:21.623422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:21.624447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 636/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 20:49:21.629675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:21.740520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866c77b-3051-4074-adfb-e184cefb4ca6 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:21.779133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:21.779780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:21.780059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:21.780336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:21.781086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:21.781399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:21.782845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5801bb-fc99-4368-9d44-dc4b77d36ea9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.795339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 623/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:21.802932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:21.830695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:21.919108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecc9b-0daa-42b9-a472-98191b84cbc4 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:21.956347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:21.956997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:21.957368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:21.957748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:21.958620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a01a4b3ff4334746912df78fae4e2fbe) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:21.958950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:21.960557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e6ff6-8ad9-4b88-8cac-940941657ccf None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:21.967519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 637/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:49:21 2022] GET /identity/v3/role_assignments?user.id=a01a4b3ff4334746912df78fae4e2fbe&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:23.935037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fae18-73b0-488d-b84e-22501f8f0074 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:23.935564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fae18-73b0-488d-b84e-22501f8f0074 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:23.935680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fae18-73b0-488d-b84e-22501f8f0074 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:23.936985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 624/1261] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:23.941910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:23.942356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:23.942451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:23.961011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:23.962175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:24.025260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 638/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:24.047792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fae18-73b0-488d-b84e-22501f8f0074 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.059011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:24.148946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fae18-73b0-488d-b84e-22501f8f0074 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.193447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.194039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.194323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.194600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.205294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:24.210210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:24.211313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:24.212397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 625/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:24.217903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.236142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:24.318002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25f8d6-dd7a-454f-95de-e50be6281202 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.352709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.353324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.353605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.353879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.354590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:24.354895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:24.356329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:24.364227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 639/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:24.370337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.437203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:24.472798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7ca41-4b07-4857-acd4-e6ba38327b42 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.506195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.506833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.507117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.507399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.517748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:24.519203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:24.533225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:24.534277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:24.535249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:24.535249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:24.535249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:24.535249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:24.535249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 626/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:24.540298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.617187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:24.636015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabdfd8-9a65-48bd-8d30-f9d5ce7c5d49 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.667398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.668555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.668839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.669110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.669787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:24.670089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:24.671435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:24.682761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 640/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:24.688836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.789286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab2c2a-5502-4ea1-bbaa-7164cdb306f5 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.808447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:24.822169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.822804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.823087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.823359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.830572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:24.832044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:24.843508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:24.844746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:24.846106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 627/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:24.850500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:24.946606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda48df-9523-4bf5-b23f-574386c0b74a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:24.979371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:24.980004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:24.980313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:24.980588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:24.981374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:24.981677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:24.983096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:24.991410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:25.000184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 641/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:25.005789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:25.108230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191f152-d6a0-42de-b026-4ff382937892 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:25.140708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:25.141369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:25.141659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:25.141977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:25.154840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:25.156867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:25.174331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:25.175399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:25.176527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:25.176527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:25.176527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:25.176527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:25.176527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 628/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:25.181951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:25.279093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1cc63-1060-4c45-b9d7-afad34a6475f None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:25.312503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:25.313113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:25.313393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:25.313664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:25.314348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:25.314651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:25.316039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:25.327531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 642/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:25.333344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:25.373087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:25.439220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24268082-bd15-462d-ad8d-27dc57332c13 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:25.471340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:25.472009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:25.472291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:25.472565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:25.479052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:25.481046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:25.492671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:25.493835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:25.495004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 629/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:25.500360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:25.557604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:25.598743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc24a-c7a7-4912-a46d-7875b8e31873 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:25.630804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:25.631348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:25.631633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:25.631935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:25.632676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:25.632981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:25.634390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a865f-d864-483d-ab24-957abfafeb86 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:25.645842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 643/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:25.652602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:25.741079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:25.749960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4b98-64e8-4871-bc5b-1d1443ce7a8d None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:25.782735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:25.783391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:25.783677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:25.783983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] PATH_INFO: `/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a01a4b3ff4334746912df78fae4e2fbe/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:25.785927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=07a821ba84e54000a2644d4fb218866a, user_id=a01a4b3ff4334746912df78fae4e2fbe, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:25.787365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06cb93-9414-4ab0-ad9a-ad095477dfe0 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:25.800052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 630/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 4 20:49:25 2022] PUT /identity/v3/projects/07a821ba84e54000a2644d4fb218866a/users/a01a4b3ff4334746912df78fae4e2fbe/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:49:27.760624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608268-32e2-4269-82bf-5fcc9c75d71e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:27.761666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608268-32e2-4269-82bf-5fcc9c75d71e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:27.761666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e608268-32e2-4269-82bf-5fcc9c75d71e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:27.762983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 644/1274] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:27.768122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:27.768568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:27.768664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:27.787159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:27.788351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:27.854385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 631/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:27.877418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608268-32e2-4269-82bf-5fcc9c75d71e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:27.974880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e608268-32e2-4269-82bf-5fcc9c75d71e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:27.991389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:28.008202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.008825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.009103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.009372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.019690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 20:49:28.024545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:28.025674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:28.027092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 645/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 4 20:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:28.034163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.111537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:28.129838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daccac0-14ca-4fff-9859-a4d169f8d88b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.168964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.169600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.169966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.170358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.171230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:28.171569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:28.173522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:28.183813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 632/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:28.189352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.285012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eee39b-a3c8-4b4f-89ca-77688cda9bd6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.317749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.318373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.318654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.318927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.329176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:28.330607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:28.345461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:28.346542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:28.347717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:28.347717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:28.347717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:28.347717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:28.347717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 646/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:28.352297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.450032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc77eb1-7e69-4dd8-9be1-f5e061722761 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.483329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.483965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.484246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.484516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.485200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:28.485501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:28.486862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:28.498222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 633/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:28.503805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.534269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:28.599972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd43af-4e0d-463b-93bc-f482bb94aca8 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.631711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.632367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.632650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.632926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.640822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:28.642273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 20:49:28.653449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:28.654585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:28.656019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 647/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:28.660424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.664169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:28.757323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beb8de-6391-4e59-a25d-a5dfac25edd9 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.790577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.791183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.791459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.791737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:28.792577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:28.792885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:28.794317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:28.812000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 634/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:28.817736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:28.906059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:28.915548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e087e0d-8e77-4c0b-ab36-bc4ed51a9593 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:28.948498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:28.949120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:28.949401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:28.949675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.014589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.016062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.100489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:29.111280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 648/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 4 20:49:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 20:49:29.117091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:29.185564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:29.222782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02844d-acf5-4984-b1b1-00d652ce835c None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:29.256072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:29.256705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:29.256985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:29.257259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.266951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.268430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 20:49:29.283420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:29.284415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:29.286504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 20:49:29.286504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 20:49:29.286504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 20:49:29.286504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:29.286504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 635/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:29.291093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:29.392523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d87e67-7cc6-4f86-974d-0921ff24016a None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:29.424824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:29.425430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:29.425714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:29.425990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.426675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:29.426981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.428380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.439726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 649/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 4 20:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:29.445587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:29.545716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74f84-57a0-4825-b179-21f7282edd48 None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:29.560731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:29.581218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:29.581856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:29.582142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:29.582419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.588985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.590469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 20:49:29.601626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:29.602664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: ERROR keystone.server.flask.application Aug 04 20:49:29.603899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 636/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 4 20:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:29.608819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:29.657659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:29.706272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e672-11cc-449d-86ec-b7c5804b63e6 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:29.738173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:29.738779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:29.739061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:29.739342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.740110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:29.740419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.741853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac411-7b2c-4f52-940b-008203bcd37f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.753414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 650/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 4 20:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:29.759892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:29.861013 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67835-05f4-4aef-b530-ca53ead0d0cb None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:29.893828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:29.894437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:29.894716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:29.894990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:29.895790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] RBAC: Adding query filter params (role.id=c757366a629b447b93eff207471f3401, scope.project.id=07a821ba84e54000a2644d4fb218866a, user.id=a01a4b3ff4334746912df78fae4e2fbe) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:29.896104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:29.897544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760a90-c6ab-4a78-8af6-36bcc58680c5 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:29.904015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 637/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 4 20:49:29 2022] GET /identity/v3/role_assignments?user.id=a01a4b3ff4334746912df78fae4e2fbe&scope.project.id=07a821ba84e54000a2644d4fb218866a&role.id=c757366a629b447b93eff207471f3401 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:31.920681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079c38-1579-4f5e-9884-490fdbb0531f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:31.921228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079c38-1579-4f5e-9884-490fdbb0531f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:31.921228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a079c38-1579-4f5e-9884-490fdbb0531f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:31.922565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 651/1288] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:31.927549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:31.928101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:31.928190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:31.946493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:31.947675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:31.976302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:32.015964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 638/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:32.039037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a079c38-1579-4f5e-9884-490fdbb0531f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:32.136498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a079c38-1579-4f5e-9884-490fdbb0531f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:32.147708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:32.176773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:32.177454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:32.177636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:32.177915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:32.178552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:32.180066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:32.190224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:32.191710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:32.192848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 652/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:49:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:32.197805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:32.298511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23718c4c-813d-4666-9b36-a0812e3cf831 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:32.331842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:32.332457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:32.332741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:32.333017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:32.333692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:32.333998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:32.335373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a6bb-464c-498e-9bec-ec003c875b10 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:32.340630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 639/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 4 20:49:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:49:32.346376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:32.442361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c51f0-338d-4105-b2bf-d41651d1260c None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:32.475043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:32.475665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:32.475977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:32.476255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] PATH_INFO: `/v3/services` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:32.476929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] RBAC: Adding query filter params (type=placement) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:32.477238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:32.478606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73d784-9eab-4948-9370-eaff1495beff None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:32.483447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 653/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 4 20:49:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:34.453678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c191-b61e-46ce-9a65-a93c559d8fda None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:34.454253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c191-b61e-46ce-9a65-a93c559d8fda None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:34.454253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c191-b61e-46ce-9a65-a93c559d8fda None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:34.455605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 640/1293] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:34.460714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7d60-d567-48d2-9fe7-56e9966e30e6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:34.461110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7d60-d567-48d2-9fe7-56e9966e30e6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:34.461270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7d60-d567-48d2-9fe7-56e9966e30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:34.478842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a07f7d60-d567-48d2-9fe7-56e9966e30e6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:34.480563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a07f7d60-d567-48d2-9fe7-56e9966e30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:34.509324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:34.548429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 654/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:34.570723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1c191-b61e-46ce-9a65-a93c559d8fda None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:34.601663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:34.674306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1c191-b61e-46ce-9a65-a93c559d8fda None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:34.707278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:34.707965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:34.708252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:34.708528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:34.709216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:34.710614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96941b4-2521-40ae-b9ad-14e11daf46f7 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:34.725410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 641/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 4 20:49:34 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:49:36.757280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4cf7-19b5-4e96-b55c-b82a3f22bcfe None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:36.757812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4cf7-19b5-4e96-b55c-b82a3f22bcfe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:36.757812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a4cf7-19b5-4e96-b55c-b82a3f22bcfe None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:36.759111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 655/1296] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:36.764217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:36.764648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:36.764787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:36.782976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:36.784192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:36.855976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 642/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:36.878183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a4cf7-19b5-4e96-b55c-b82a3f22bcfe None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:36.975595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a4cf7-19b5-4e96-b55c-b82a3f22bcfe None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:37.008210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:37.008771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:37.009053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:37.009323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:37.009943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:37.011378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:37.020039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:37.021316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:37.022460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 656/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:49:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:37.027679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:37.046493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:37.125360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05b9c-6165-4343-bb97-e3fe96ebd84f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:37.163988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:37.164855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:37.165180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:37.165469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:37.166439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:37.166855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:37.169286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:37.176004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 643/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 4 20:49:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:49:37.183848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:37.225709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:37.295294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d95b-a6b2-4c9d-8a71-5496d4204283 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:37.327210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:37.327848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:37.328133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:37.328404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:37.329156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] RBAC: Adding query filter params (interface=public, service_id=bff3bf71fce44f1798b0d14275662074, region_id=RegionOne) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:37.329463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:37.330820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36f488-4366-4948-b90e-a3867ca9c25f None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:37.335639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 657/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 4 20:49:37 2022] GET /identity/v3/endpoints?service_id=bff3bf71fce44f1798b0d14275662074&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:37.342196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:37.420886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:37.438606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e370b6c-fa1f-4a94-bfa0-92b90c25f0bd None admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:37.473016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:37.473642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:37.473926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:37.474202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:37.474854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:37.476326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba65863-6c40-4c0a-b978-8e3b774e2c25 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:37.483161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 644/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 4 20:49:37 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:49:39.472108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1ed0-6888-4896-b6b1-d86a7887ca60 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:39.472557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1ed0-6888-4896-b6b1-d86a7887ca60 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:39.472651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1ed0-6888-4896-b6b1-d86a7887ca60 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:39.473990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 658/1302] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:49:39.479170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:39.479605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:39.479734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:39.497500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:49:39.498683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:49:39.563700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 645/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:49:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 20:49:39.586579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1ed0-6888-4896-b6b1-d86a7887ca60 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:39.678780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:39.685478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1ed0-6888-4896-b6b1-d86a7887ca60 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:39.718495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:39.719052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:39.719330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:39.719603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:39.720254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:39.721613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 20:49:39.730166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 20:49:39.735954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application with Lock( Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self._enter() Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application return self.creator() Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application created_value = creator( Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: ERROR keystone.server.flask.application Aug 04 20:49:39.737047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 659/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 4 20:49:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 20:49:39.738080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:39.811150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:39.834241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0759-3d41-4ee6-acd5-2e35d1eb2358 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:39.867070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:39.867676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:39.867981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:39.868251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] PATH_INFO: `/v3/services` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:39.868919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:49:39.869218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:39.871072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3cdb5-9462-4c92-9698-99ae05fdcb59 None admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:39.876091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 646/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 4 20:49:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:49:39.881957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:49:39.980481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea3b92-406a-408b-abff-a41a91505725 None admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:49:40.013224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:49:40.013828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:49:40.014110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:49:40.014386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:49:40.015082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:49:40.016475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa07ff-d33c-4874-b362-c3bfe1f332d2 None admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:49:40.035468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 660/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:49:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:49:49.873133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=30 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:49:50.031950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:42.275177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f538-5e96-4d41-bc4f-5bbb7c6c2281 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:42.276279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f538-5e96-4d41-bc4f-5bbb7c6c2281 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:42.276799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03f538-5e96-4d41-bc4f-5bbb7c6c2281 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:42.284045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcb9a-086c-4fed-b02d-b0a0ed55805a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:42.284919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcb9a-086c-4fed-b02d-b0a0ed55805a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:42.285445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcb9a-086c-4fed-b02d-b0a0ed55805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:42.290360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 647/1307] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:42 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:42.374056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bdefcb9a-086c-4fed-b02d-b0a0ed55805a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:42.375779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bdefcb9a-086c-4fed-b02d-b0a0ed55805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:42.514308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 661/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:42.575450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:42.575992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:42.576480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:42.578742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 648/1309] 10.222.0.45 () {54 vars in 965 bytes} [Thu Aug 4 20:50:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:42.587137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0d0bf-e5da-4f4d-ac0c-0ed72e74f3e8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:42.587436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0d0bf-e5da-4f4d-ac0c-0ed72e74f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:42.587700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0d0bf-e5da-4f4d-ac0c-0ed72e74f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:42.723717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-90f0d0bf-e5da-4f4d-ac0c-0ed72e74f3e8 None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:42.725003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-90f0d0bf-e5da-4f4d-ac0c-0ed72e74f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:42.750137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:42.819806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 662/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Aug 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:42.828628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:42.830722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:42.945796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1948-f5a7-4f57-ab7b-5c88af37c424 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:43.022873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:43.023499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:43.023805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:43.024085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:43.025736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:43.084063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:43.142296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:43.143780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e33291-f368-4234-8194-78a7051d817e service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:43.167588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 649/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:50:45.454803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:45.455376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:45.455376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:45.457173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 663/1312] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:45.466744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0986d-a495-46a4-9da7-40b8ffd0d0ca None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:45.467294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0986d-a495-46a4-9da7-40b8ffd0d0ca None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:45.467294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0986d-a495-46a4-9da7-40b8ffd0d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:45.549426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-53f0986d-a495-46a4-9da7-40b8ffd0d0ca None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:45.550666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-53f0986d-a495-46a4-9da7-40b8ffd0d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:45.664905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 650/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:45.698397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:45.700012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:45.820895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669efb76-c17b-4444-9245-3e0f3329768e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:45.909138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:45.912117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:45.913160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:45.913581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:45.914295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:45.916894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:46.032782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:46.034534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8e56c-56cb-4093-a01f-394af2e34dcf service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:46.052685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 664/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:50:48.400596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a20-e00d-4ee3-abbd-65991cda1183 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:48.401194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a20-e00d-4ee3-abbd-65991cda1183 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:48.401194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a323a20-e00d-4ee3-abbd-65991cda1183 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:48.402504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 651/1315] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:48.408625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe45b4-7e42-4d59-bc18-07b0ad8b8733 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:48.409101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe45b4-7e42-4d59-bc18-07b0ad8b8733 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:48.409211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe45b4-7e42-4d59-bc18-07b0ad8b8733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:48.478532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-febe45b4-7e42-4d59-bc18-07b0ad8b8733 None None] MFA Rules not processed for user `c69133dfb93e42eea2175539531bcb21`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:48.479800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-febe45b4-7e42-4d59-bc18-07b0ad8b8733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:48.532891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:48.576893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 665/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:50:48.634494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:48.634776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:48.635052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:48.636491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 652/1317] 10.222.0.45 () {54 vars in 965 bytes} [Thu Aug 4 20:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:48.642792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d0791-3d45-4d77-afa3-c75664d20c06 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:48.643085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d0791-3d45-4d77-afa3-c75664d20c06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:48.643364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d0791-3d45-4d77-afa3-c75664d20c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:48.719789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cf9d0791-3d45-4d77-afa3-c75664d20c06 None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:48.721008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf9d0791-3d45-4d77-afa3-c75664d20c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:48.798565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 666/1318] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Aug 4 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:48.807572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:48.809118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:48.819205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:48.911601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9966014-4545-46cd-a7e5-a6a0f73706af None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:48.983571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:48.984125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:48.984406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:48.984685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:48.986316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:49.047865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:49.098106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:49.099591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5031-c4cc-426f-94ad-dde8bdfbb966 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:49.117772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 653/1319] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:50:52.024458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:52.025002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:52.025002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:52.026405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 667/1320] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:52.032576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124ea4-f619-4cd5-8b24-15a6b36aa361 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:52.033006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124ea4-f619-4cd5-8b24-15a6b36aa361 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:52.033110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124ea4-f619-4cd5-8b24-15a6b36aa361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:52.097852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ad124ea4-f619-4cd5-8b24-15a6b36aa361 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:52.099055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ad124ea4-f619-4cd5-8b24-15a6b36aa361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:52.194215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 654/1321] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:52.233920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:52.235433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:52.285894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:52.340468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129277af-476d-4dd6-a84b-f1427c256e6a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:52.414657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:52.415276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:52.415554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:52.415862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:52.417453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:52.509599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:52.524801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:52.526240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bda63-f996-4ac7-aee4-991ef526cb6e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:52.544511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 668/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:50:55.226377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787736-af00-4df0-a686-bb58e8797485 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:55.226957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787736-af00-4df0-a686-bb58e8797485 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:55.226957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787736-af00-4df0-a686-bb58e8797485 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:55.228322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 655/1323] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:55.233530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58404d5-aedc-4628-9435-88e6fb52bddd None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:55.233994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58404d5-aedc-4628-9435-88e6fb52bddd None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:55.234090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58404d5-aedc-4628-9435-88e6fb52bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:55.300309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c58404d5-aedc-4628-9435-88e6fb52bddd None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:55.301524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c58404d5-aedc-4628-9435-88e6fb52bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:55.402488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 669/1324] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:55.441120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787736-af00-4df0-a686-bb58e8797485 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:55.442678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-08787736-af00-4df0-a686-bb58e8797485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:55.464838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:55.554494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787736-af00-4df0-a686-bb58e8797485 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:55.630593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:55.631218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:55.631502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:55.631845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:55.633453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:55.707759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:55.748267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:55.749641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a019a-b5ae-4211-bf43-98899e0bf523 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:55.768467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 656/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:50:57.833692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:57.834229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:57.834229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:57.835510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 670/1326] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:50:57.840960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dae83-464f-4146-93ca-bdd9c3e9333a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:57.841433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dae83-464f-4146-93ca-bdd9c3e9333a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:57.841679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dae83-464f-4146-93ca-bdd9c3e9333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:57.908621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bb4dae83-464f-4146-93ca-bdd9c3e9333a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:50:57.909898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bb4dae83-464f-4146-93ca-bdd9c3e9333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:58.006707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 657/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:50:58.042943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:50:58.045049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:58.106276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:58.151656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f75a1a-4dc2-406a-a4cb-3baa8a0c36a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:50:58.228417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:50:58.229050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:50:58.229332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:50:58.229607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:50:58.231316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:50:58.342582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:50:58.345185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:50:58.346720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa086236-5808-47bb-87ce-24ea98e31ee9 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:50:58.366887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 671/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:00.439091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:00.439636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:00.439636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:00.441060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 658/1329] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:00.446333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a1fa-984b-4c7b-bb65-5873074fbef5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:00.446780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a1fa-984b-4c7b-bb65-5873074fbef5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:00.446887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606a1fa-984b-4c7b-bb65-5873074fbef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:00.517885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7606a1fa-984b-4c7b-bb65-5873074fbef5 None None] MFA Rules not processed for user `c69133dfb93e42eea2175539531bcb21`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:00.519037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7606a1fa-984b-4c7b-bb65-5873074fbef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:00.620457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 672/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:00.658751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:00.660390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:00.696770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:00.770734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0cc2-7d6a-46e7-97f8-64bdd4e0c38d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:00.847104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:00.847763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:00.848056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:00.848331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:00.850039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:00.929578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:00.961373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:00.962835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364cb1a-4148-4db0-9e70-4ef88fab7d66 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:00.981093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 659/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:03.221595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:03.222155 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:03.222155 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:03.223488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 673/1332] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:03.228533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876af8-d9e6-4b1a-9411-2df213cac77b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:03.228989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876af8-d9e6-4b1a-9411-2df213cac77b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:03.229115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f876af8-d9e6-4b1a-9411-2df213cac77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:03.295917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1f876af8-d9e6-4b1a-9411-2df213cac77b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:03.297123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f876af8-d9e6-4b1a-9411-2df213cac77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:03.391402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 660/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:03.427650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:03.429272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:03.509331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:03.543035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3edba-18c4-4065-ad36-f77b742bdca3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:03.614338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:03.614939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:03.615216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:03.615481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:03.617094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:03.724329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:03.725762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a51b5-8fca-4cf2-b38f-8fb871ebb9a7 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:03.735851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:03.744701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 674/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:05.791502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:05.792053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:05.792053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:05.793347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 661/1335] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:05.798966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47916a3-5695-4c42-b27e-3c8db0bdd874 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:05.799376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47916a3-5695-4c42-b27e-3c8db0bdd874 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:05.799522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47916a3-5695-4c42-b27e-3c8db0bdd874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:05.869593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c47916a3-5695-4c42-b27e-3c8db0bdd874 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:05.870809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c47916a3-5695-4c42-b27e-3c8db0bdd874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:05.973207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 675/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:06.012757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:06.014829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:06.055813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:06.120486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b8ecc-93bf-4e16-a481-8a1a99dd2f37 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:06.193789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:06.194407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:06.194690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:06.194963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:06.196631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:06.279922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:06.305371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:06.306860 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc147b92-c7aa-45c8-9165-faf63150a70f service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:06.325023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 662/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:08.670334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:08.670955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:08.670955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:08.672281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 676/1338] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:08.677361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3131f-68ac-479f-81a8-40b54ff8d947 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:08.677773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3131f-68ac-479f-81a8-40b54ff8d947 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:08.677916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3131f-68ac-479f-81a8-40b54ff8d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:08.742613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7bb3131f-68ac-479f-81a8-40b54ff8d947 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:08.743723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7bb3131f-68ac-479f-81a8-40b54ff8d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:08.838918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 663/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:08.876098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:08.877770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:08.957485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:08.986796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1965f-262e-4808-b8b2-05a348472f8a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:09.058595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:09.059140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:09.059422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:09.059697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:09.061376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:09.172874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:09.174682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d7bb-a25a-4a00-835a-e64e3a2ebad6 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:09.193193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 677/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:13.109409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:13.109982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:13.109982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:13.111376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 664/1341] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:13.116701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bd79-acfe-4541-a8dc-5243dcec279c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:13.117132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bd79-acfe-4541-a8dc-5243dcec279c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:13.117249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bd79-acfe-4541-a8dc-5243dcec279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:13.122882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:13.187553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a681bd79-acfe-4541-a8dc-5243dcec279c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:13.188816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a681bd79-acfe-4541-a8dc-5243dcec279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:13.283587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 678/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:13.322712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:13.324257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:13.372113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:13.427511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ccbc0-11f2-40ac-849d-7e86916349d5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:13.501281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:13.501902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:13.502186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:13.502463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:13.504130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:13.597846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:13.614446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:13.615926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14a7f7-4ed5-4639-ade2-bddc13ade222 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:13.634094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 665/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:16.284510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:16.285113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:16.285113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:16.286446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 679/1344] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:16.292873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf3d-21a1-4dbe-b94f-792c8034d3c6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:16.293451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf3d-21a1-4dbe-b94f-792c8034d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:16.293451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cf3d-21a1-4dbe-b94f-792c8034d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:16.366614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a568cf3d-21a1-4dbe-b94f-792c8034d3c6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:16.367881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a568cf3d-21a1-4dbe-b94f-792c8034d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:16.473582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 666/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:51:16.519156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:16.520752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:16.612459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:16.634501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c5fb-a1b2-4825-bf9a-f70834ef2cc7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:16.715309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:16.715961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:16.716246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:16.716519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:16.718144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:16.827410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:16.828891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1b19e-fca3-4336-b8c2-6f391d978152 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:16.847536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 680/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:20.819070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:20.819607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:20.819607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:20.821028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 667/1347] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:20.826859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7fd2-54ea-4f8f-993d-f2d4e48b9c61 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:20.827659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7fd2-54ea-4f8f-993d-f2d4e48b9c61 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:20.827957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7fd2-54ea-4f8f-993d-f2d4e48b9c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:20.843526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:20.893802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5aab7fd2-54ea-4f8f-993d-f2d4e48b9c61 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:20.895051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5aab7fd2-54ea-4f8f-993d-f2d4e48b9c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:20.993179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 681/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:21.031478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:21.033224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:21.110164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:21.159984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cc446-df0e-4a85-af92-d3bfe681fcd5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:21.238401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:21.239027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:21.239310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:21.239586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:21.241275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:21.358507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:21.362186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:21.364129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549a6c-eeca-4c34-b91f-aa9f477b3eca service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:21.383102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 668/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:26.327221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86992cea-614a-46f0-bf1a-a0366cdddce0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:26.327716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86992cea-614a-46f0-bf1a-a0366cdddce0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:26.327716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86992cea-614a-46f0-bf1a-a0366cdddce0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:26.329402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 682/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:26.341713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a405f7-402f-48da-a2fe-ba29620aa9da None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:26.342193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a405f7-402f-48da-a2fe-ba29620aa9da None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:26.342276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a405f7-402f-48da-a2fe-ba29620aa9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:26.458236 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-83a405f7-402f-48da-a2fe-ba29620aa9da None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:26.462397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-83a405f7-402f-48da-a2fe-ba29620aa9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:26.571675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 669/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:30.583847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa02e-4541-4810-8098-609613c3e222 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:30.584437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa02e-4541-4810-8098-609613c3e222 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:30.584437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa02e-4541-4810-8098-609613c3e222 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:30.585962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 683/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:30.590826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1795-9049-474f-8860-011118621c1b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:30.591685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1795-9049-474f-8860-011118621c1b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:30.592237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1795-9049-474f-8860-011118621c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:30.653687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:30.679732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-58cb1795-9049-474f-8860-011118621c1b None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:30.682767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-58cb1795-9049-474f-8860-011118621c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:30.807283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 670/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:30.992217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=59 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:32.237600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481bc2-1f09-4159-8d02-0e9102528266 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:32.238234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481bc2-1f09-4159-8d02-0e9102528266 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:32.238234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a481bc2-1f09-4159-8d02-0e9102528266 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:32.239521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 684/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:32.244468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444f96-cb43-490c-936d-13ceb56a9098 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:32.244887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444f96-cb43-490c-936d-13ceb56a9098 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:32.245019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da444f96-cb43-490c-936d-13ceb56a9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:32.322210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-da444f96-cb43-490c-936d-13ceb56a9098 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:32.323418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-da444f96-cb43-490c-936d-13ceb56a9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:32.365045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:32.432826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 671/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:51:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:35.889723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5ad4-d466-47c7-985a-f89d01045aac None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:35.890573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5ad4-d466-47c7-985a-f89d01045aac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:35.891019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a5ad4-d466-47c7-985a-f89d01045aac None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:35.893593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 685/1356] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:35.898752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557e85-f595-440f-a8a8-a283b199b35c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:35.899563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557e85-f595-440f-a8a8-a283b199b35c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:35.900020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13557e85-f595-440f-a8a8-a283b199b35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:36.003090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-13557e85-f595-440f-a8a8-a283b199b35c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:36.004397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-13557e85-f595-440f-a8a8-a283b199b35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:36.125415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 672/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:36.189108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:36.189727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:36.190239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:36.192018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 686/1358] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 4 20:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:36.200023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbc4e-116b-4c48-981c-a7e26c87d656 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:36.200735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbc4e-116b-4c48-981c-a7e26c87d656 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:36.201263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcbc4e-116b-4c48-981c-a7e26c87d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:36.223671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:36.324337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-94fcbc4e-116b-4c48-981c-a7e26c87d656 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:36.326935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-94fcbc4e-116b-4c48-981c-a7e26c87d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:36.472513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 673/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 4 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:36.483926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:36.485422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:36.648587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd140e-fe1e-451c-8978-23416fc37d13 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:36.727312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:36.776806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:36.776806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:36.776806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:36.776806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:36.778652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:36.893598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:36.896242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd9b6-9e7d-43db-a10f-2503c869f21e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:36.921205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 687/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:39.241632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:39.242097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:39.242369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:39.244303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 674/1361] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:39.250628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab0ac-c585-4235-894d-bdc7089d14ac None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:39.251027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab0ac-c585-4235-894d-bdc7089d14ac None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:39.251297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dab0ac-c585-4235-894d-bdc7089d14ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:39.349063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-50dab0ac-c585-4235-894d-bdc7089d14ac None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:39.350929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-50dab0ac-c585-4235-894d-bdc7089d14ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:39.392843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:39.482295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 688/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:39.530646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:39.533168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:39.616670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:39.710722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b94d92-46eb-4579-b8f5-5d49b2a2e197 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:39.862052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:39.862780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:39.863134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:39.863482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:39.865416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:39.893784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:39.982802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:39.984460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45967e9-8ddd-456f-89aa-15167b4b2761 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:40.004239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 675/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:42.498821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc107c-4895-4f95-833a-644e3eeff39a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:42.499360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc107c-4895-4f95-833a-644e3eeff39a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:42.499360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc107c-4895-4f95-833a-644e3eeff39a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:42.500879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 689/1364] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:42.507136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379602a-6720-4eb1-b891-e639903a7a92 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:42.507862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379602a-6720-4eb1-b891-e639903a7a92 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:42.508341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379602a-6720-4eb1-b891-e639903a7a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:42.600861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1379602a-6720-4eb1-b891-e639903a7a92 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:42.602091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1379602a-6720-4eb1-b891-e639903a7a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:42.731553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:42.743186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 676/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:42.781735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:42.782035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:42.782352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:42.784192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 690/1366] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 4 20:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:42.790819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cebcb7-bff3-478c-8c7d-76cb16a33dc0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:42.791399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cebcb7-bff3-478c-8c7d-76cb16a33dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:42.791937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cebcb7-bff3-478c-8c7d-76cb16a33dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:42.898163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-97cebcb7-bff3-478c-8c7d-76cb16a33dc0 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:42.899647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-97cebcb7-bff3-478c-8c7d-76cb16a33dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:43.028962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 677/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 4 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:43.037530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:43.039017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:43.204831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053cd25-867a-41c7-a390-4a5793bbfab1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:43.227392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:43.331091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:43.331624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:43.331931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:43.332202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:43.333877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:43.435074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:43.437300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0495a-1b64-44fe-b49a-fcebaa9df0ca service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:43.460333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 691/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:44.628960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8e75-2ab2-42fa-b979-03d942d4b62a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:44.629493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8e75-2ab2-42fa-b979-03d942d4b62a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:44.629493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b8e75-2ab2-42fa-b979-03d942d4b62a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:44.630960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 678/1369] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:44.636213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909447-8d9e-4b48-8f9c-962e0f5258d1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:44.636713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909447-8d9e-4b48-8f9c-962e0f5258d1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:44.636994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909447-8d9e-4b48-8f9c-962e0f5258d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:44.672000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:44.711846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d3909447-8d9e-4b48-8f9c-962e0f5258d1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:44.713221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d3909447-8d9e-4b48-8f9c-962e0f5258d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:44.820092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 692/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:51:45.205917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:45.206426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:45.206855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:45.208600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 679/1371] 10.222.0.45 () {54 vars in 964 bytes} [Thu Aug 4 20:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:45.213590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb72c-0ad1-4d95-b1df-a453f85f192c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:45.214083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb72c-0ad1-4d95-b1df-a453f85f192c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:45.214509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eb72c-0ad1-4d95-b1df-a453f85f192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:45.296260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ba6eb72c-0ad1-4d95-b1df-a453f85f192c None None] MFA Rules not processed for user `31f9af670ced484a8c829f245bd08ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:45.297741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba6eb72c-0ad1-4d95-b1df-a453f85f192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:45.349449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:45.383077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 693/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Aug 4 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:45.390832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:45.392376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:45.448580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:45.519270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ce52e-9ef2-479a-a307-e90b0e80dec6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:45.585692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76c2e-12d4-40da-93f5-25110aced6c2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:45.586067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76c2e-12d4-40da-93f5-25110aced6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:45.586259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76c2e-12d4-40da-93f5-25110aced6c2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:45.591494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 694/1373] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:45.593217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60f96-3de6-42b3-a211-9661868bd740 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:45.593511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60f96-3de6-42b3-a211-9661868bd740 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:45.593796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd60f96-3de6-42b3-a211-9661868bd740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:45.600902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:45.601771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:45.602265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:45.602721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:45.604576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:45.674633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8dd60f96-3de6-42b3-a211-9661868bd740 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:45.676467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8dd60f96-3de6-42b3-a211-9661868bd740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:45.718109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:45.738176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:45.739680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:45.768199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 680/1374] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:45.796394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 695/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:45.840656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:45.841987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:45.954489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308afaed-8ac6-4db0-b2ba-5ffbcc41a78f service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:46.070468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:46.084001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:46.084624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:46.084907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:46.085186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:46.086815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:46.178153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:46.179939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cbad5-8942-468b-ba79-291ec256c89c service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:46.198770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 681/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:48.225329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:48.225795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:48.225891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:48.227251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 696/1377] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:48.233195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc718f2-8a16-415d-8422-39b58c38f168 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:48.233631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc718f2-8a16-415d-8422-39b58c38f168 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:48.233902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc718f2-8a16-415d-8422-39b58c38f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:48.309294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0cc718f2-8a16-415d-8422-39b58c38f168 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:48.311528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0cc718f2-8a16-415d-8422-39b58c38f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:48.377504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:48.416839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 682/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:48.460580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:48.462149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:48.513422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:48.614746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541947ef-4438-42fc-a9bc-507b642b9edf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:48.765614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:48.766132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:48.766411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:48.766681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:48.768341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:48.780748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:48.861063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:48.862668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfd85e-f435-4559-ace8-bd38a4da3e22 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:48.880314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 697/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:50.962100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:50.962636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:50.962636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:50.964233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 683/1380] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:50.969482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dedff-e125-4a0b-8a15-f48518f18443 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:50.969907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dedff-e125-4a0b-8a15-f48518f18443 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:50.970080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dedff-e125-4a0b-8a15-f48518f18443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:51.044668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c02dedff-e125-4a0b-8a15-f48518f18443 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:51.046399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c02dedff-e125-4a0b-8a15-f48518f18443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:51.135737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:51.149835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 698/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:51.195989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:51.197658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:51.368307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141df9-0d72-41bb-ab28-ce55a9c37433 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:51.418706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:51.496197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:51.496818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:51.497099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:51.497373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:51.499007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:51.599807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:51.601434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418600dd-9b0f-4399-974c-f818d084ab87 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:51.620559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 684/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:53.687976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:53.688678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:53.688678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:53.689907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 699/1383] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:53.695535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7888d3-c731-48f8-9cf1-f6ce50c10d53 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:53.695989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7888d3-c731-48f8-9cf1-f6ce50c10d53 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:53.696261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7888d3-c731-48f8-9cf1-f6ce50c10d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:53.771875 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4b7888d3-c731-48f8-9cf1-f6ce50c10d53 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:53.773045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b7888d3-c731-48f8-9cf1-f6ce50c10d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:53.775223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:53.880574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 685/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:53.924037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:53.925537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:54.070597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b07e6-cc17-4067-b15a-d5d10b2a2e47 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:54.133877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:54.194095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:54.194920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:54.195265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:54.195611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:54.197716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:54.306055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:54.308121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9ca8d-f7a4-4cbf-9385-af62dfba7e5f service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:54.329630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 700/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:56.446867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:56.447431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:56.447564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:56.449318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 686/1386] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:56.455159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f0ad-d602-4e87-8009-7c918a8638ef None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:56.455644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f0ad-d602-4e87-8009-7c918a8638ef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:56.456030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5f0ad-d602-4e87-8009-7c918a8638ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:56.649115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-39b5f0ad-d602-4e87-8009-7c918a8638ef None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:56.650400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-39b5f0ad-d602-4e87-8009-7c918a8638ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:56.682105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:56.755191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 701/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:56.802960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:56.804938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:56.957208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:56.975769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748cbe4-9f4c-46d8-8635-77b04690c318 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:57.116981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:57.118017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:57.118545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:57.118904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:57.121320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:57.227589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:57.229187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf262d-ef68-4336-a6f7-08a1f8c0c83b service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:57.234177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:57.249040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 687/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:51:59.287543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:59.288128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:59.288128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:59.289477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 702/1389] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:51:59.294737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71cc6f-84f2-4a91-a96c-247e12423c6f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:59.295215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71cc6f-84f2-4a91-a96c-247e12423c6f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:59.295316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71cc6f-84f2-4a91-a96c-247e12423c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:59.362846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7a71cc6f-84f2-4a91-a96c-247e12423c6f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:51:59.364119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a71cc6f-84f2-4a91-a96c-247e12423c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:59.461590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 688/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:51:59.505699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:51:59.507271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:59.651660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f9507-d32b-4bf5-9f8c-7e97119e6894 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:51:59.660990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:51:59.764720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:51:59.765342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:51:59.765739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:51:59.766019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:51:59.767670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:51:59.858369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:51:59.859992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0541b-f5f2-4f85-b9c8-fcd8b629a7dd service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:51:59.879909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 703/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:00.793121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72b51-20bb-4af3-84fc-54aff7a9e136 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:00.793682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72b51-20bb-4af3-84fc-54aff7a9e136 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:00.793786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee72b51-20bb-4af3-84fc-54aff7a9e136 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:00.795162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 689/1392] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:00.800490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e4b46-aa71-4472-b882-900cec8b1f2e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:00.800923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e4b46-aa71-4472-b882-900cec8b1f2e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:00.801031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e4b46-aa71-4472-b882-900cec8b1f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:00.816658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:00.868342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b09e4b46-aa71-4472-b882-900cec8b1f2e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:00.869519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b09e4b46-aa71-4472-b882-900cec8b1f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:00.965929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 704/1393] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:01.023412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:01.023700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:01.024030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:01.025404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 690/1394] 10.222.0.45 () {54 vars in 966 bytes} [Thu Aug 4 20:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:01.030367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba502d2b-4066-492d-a1ab-e29f61723a3f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:01.030660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba502d2b-4066-492d-a1ab-e29f61723a3f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:01.030937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba502d2b-4066-492d-a1ab-e29f61723a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:01.107739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ba502d2b-4066-492d-a1ab-e29f61723a3f None None] MFA Rules not processed for user `c49b3e48a8784ac5894e8399a737f3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:01.109490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ba502d2b-4066-492d-a1ab-e29f61723a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:01.143739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:01.186157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 705/1395] 10.222.0.45 () {58 vars in 1063 bytes} [Thu Aug 4 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:01.194282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:01.196121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:01.271473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:01.303601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f8cc3-af80-4f86-8399-a782e8866253 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:01.376977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:01.377510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:01.377796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:01.378073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:01.379695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:01.495512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:01.497023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ccf45-eae3-4e70-bb60-5a8ae33db98c service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:01.512398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:01.516664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 691/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:01.903291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:01.903948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:01.903948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:01.905822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 706/1397] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:01.911258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46b18-55b7-42e8-9c11-0784a2c6bf21 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:01.911679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46b18-55b7-42e8-9c11-0784a2c6bf21 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:01.911906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46b18-55b7-42e8-9c11-0784a2c6bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:01.979558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e6e46b18-55b7-42e8-9c11-0784a2c6bf21 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:01.980764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e6e46b18-55b7-42e8-9c11-0784a2c6bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.090358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 692/1398] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:02.137077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:02.138768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.250164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389f57-6814-44d2-a8e0-29a4eb753fec None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:02.250454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389f57-6814-44d2-a8e0-29a4eb753fec None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:02.250728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17389f57-6814-44d2-a8e0-29a4eb753fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:02.298644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd3de-c62c-4615-afe0-7eff6bd536d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:02.318749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-17389f57-6814-44d2-a8e0-29a4eb753fec None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:02.320103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-17389f57-6814-44d2-a8e0-29a4eb753fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.338999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:02.350364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:02.408266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 693/1399] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:52:02.413417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:02.414044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:02.414322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:02.414595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:02.416326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.456180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee29f-7d34-4ac6-8674-46715c0f4886 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:02.456461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee29f-7d34-4ac6-8674-46715c0f4886 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:02.456741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ee29f-7d34-4ac6-8674-46715c0f4886 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:02.458272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 694/1400] 10.222.0.45 () {54 vars in 943 bytes} [Thu Aug 4 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:52:02.465532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebc563-46cc-40c3-bf02-b1e58bf3a238 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:02.465532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebc563-46cc-40c3-bf02-b1e58bf3a238 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:02.465726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebc563-46cc-40c3-bf02-b1e58bf3a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:02.512062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:02.513585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:02.532761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 707/1401] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:02.543959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d5ebc563-46cc-40c3-bf02-b1e58bf3a238 None None] MFA Rules not processed for user `dc7e41de613b48f9a9cb7e0a5ceb0aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:02.545179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d5ebc563-46cc-40c3-bf02-b1e58bf3a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.662515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 695/1402] 10.222.0.45 () {58 vars in 1040 bytes} [Thu Aug 4 20:52:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:52:02.672296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:02.673532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.723342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:02.767187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2895a-ab27-445d-ab3e-0c139bf6c84c service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:02.870731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:02.871384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:02.871663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:02.871970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:02.874161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:02.954760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:02.958733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:02.960391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9cee1-4b1e-49ab-a8e4-f73b0eaec5a7 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:02.969194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 708/1403] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 20:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 20:52:04.587299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:04.587917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:04.587917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:04.592108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 696/1404] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:52:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:04.594899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc33027-a717-458f-99c3-4d1f703a76be None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:04.595329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc33027-a717-458f-99c3-4d1f703a76be None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:04.595463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc33027-a717-458f-99c3-4d1f703a76be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:04.666171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3fc33027-a717-458f-99c3-4d1f703a76be None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:04.667635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3fc33027-a717-458f-99c3-4d1f703a76be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:04.784160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 709/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:04.829420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:04.831023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:04.835234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:05.003963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1920e-ae6a-457a-b03e-3462a036ebf8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:05.089836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:05.138447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:05.139731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:05.140042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:05.140321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:05.141971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:05.263417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:05.265318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59659c8c-fdaf-42aa-8ec9-c33b283c4faa service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:05.284594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 697/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:07.348019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:07.348626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:07.348626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:07.349928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 710/1407] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:07.355158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f282-1440-4d26-a6a9-50726b55355c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:07.355578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f282-1440-4d26-a6a9-50726b55355c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:07.355776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f282-1440-4d26-a6a9-50726b55355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:07.435304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9116f282-1440-4d26-a6a9-50726b55355c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:07.436592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9116f282-1440-4d26-a6a9-50726b55355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:07.484239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:07.555073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 698/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:07.600152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:07.602837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:07.688210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:07.762728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2be9b-75d2-4bf5-9442-545fd9a6221d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:07.895770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:07.896302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:07.896580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:07.896869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:07.898482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:07.937236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:08.002493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:08.004276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c6556-11d6-4af1-91d5-922da81ef4cf service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:08.022727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 711/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:17.552119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=26 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:18.020452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=30 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:25.662573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116c21-24b5-4387-b228-03121535e9b9 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:25.663162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116c21-24b5-4387-b228-03121535e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:25.663162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93116c21-24b5-4387-b228-03121535e9b9 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:25.664528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 699/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu Aug 4 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:25.669744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e022e-00f4-45ee-b71a-97ac27f3bea6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:25.670166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e022e-00f4-45ee-b71a-97ac27f3bea6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:25.670802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e022e-00f4-45ee-b71a-97ac27f3bea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:25.747086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-844e022e-00f4-45ee-b71a-97ac27f3bea6 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:25.748241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-844e022e-00f4-45ee-b71a-97ac27f3bea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:25.853120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 712/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Aug 4 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:25.868126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94eb3a-c0c3-4587-a2e7-4bd29f963334 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:25.868424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94eb3a-c0c3-4587-a2e7-4bd29f963334 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:25.868708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94eb3a-c0c3-4587-a2e7-4bd29f963334 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:25.870070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 700/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu Aug 4 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:25.874560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b0dd-e8de-4a5e-ac55-d81b38714042 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:25.874843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b0dd-e8de-4a5e-ac55-d81b38714042 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:25.875118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b0dd-e8de-4a5e-ac55-d81b38714042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:25.947597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:25.950159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4395b0dd-e8de-4a5e-ac55-d81b38714042 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:25.952189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4395b0dd-e8de-4a5e-ac55-d81b38714042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:26.066589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 713/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Aug 4 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:28.529846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:28.530362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:28.530480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:28.531808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:28.537173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25209dc0-25e0-413c-a19d-bab6417ff4e3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:28.537608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25209dc0-25e0-413c-a19d-bab6417ff4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:28.537741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25209dc0-25e0-413c-a19d-bab6417ff4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:28.602946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-25209dc0-25e0-413c-a19d-bab6417ff4e3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:28.604187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-25209dc0-25e0-413c-a19d-bab6417ff4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:28.659004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:28.700967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:28.743367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:28.744970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:28.889205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57003-765f-4449-8ae9-a7b28455ef3d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:28.961839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:29.002649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:29.003195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:29.003474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:29.003779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:29.005395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:29.092887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:29.094500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7896d8-1d48-4c33-955d-82f9751309d4 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:29.112790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 702/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:30.007753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:30.008243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:30.008358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:30.009696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:30.014680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0578-0f7c-437b-940e-6dc17db8adb4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:30.015124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0578-0f7c-437b-940e-6dc17db8adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:30.015264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0578-0f7c-437b-940e-6dc17db8adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:30.090540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-08ca0578-0f7c-437b-940e-6dc17db8adb4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:30.091763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-08ca0578-0f7c-437b-940e-6dc17db8adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:30.118593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:30.188789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:30.339484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:30.340966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:30.484809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe4c2-9133-40e2-b299-b12144e0dac2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:30.523867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:30.596387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:30.596931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:30.597213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:30.597490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:30.599107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:30.686677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:30.688293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974c10-108e-40c5-84c8-085735a46c4a service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:30.706240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 716/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:31.582806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:31.583373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:31.583373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:31.584751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:31.589668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80ff6-7191-453b-a838-65db120666bc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:31.590090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80ff6-7191-453b-a838-65db120666bc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:31.590221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80ff6-7191-453b-a838-65db120666bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:31.644523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:31.665956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-01e80ff6-7191-453b-a838-65db120666bc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:31.667147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-01e80ff6-7191-453b-a838-65db120666bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:31.762619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:31.914004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:31.915516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:32.060173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f07251-f27d-437c-bb40-ea3ffa8d637e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:32.073046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:32.176447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:32.177070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:32.177352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:32.177629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:32.179264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:32.268604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:32.270267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c834d06-79a5-4649-b560-e7e6a8c145a2 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:32.289393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 705/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:33.145166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:33.145746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:33.145746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:33.147126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:33.151989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe2d0-98b0-4420-9910-c627297ea32f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:33.152443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe2d0-98b0-4420-9910-c627297ea32f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:33.152560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe2d0-98b0-4420-9910-c627297ea32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:33.173405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:33.229732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2dcbe2d0-98b0-4420-9910-c627297ea32f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:33.230943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2dcbe2d0-98b0-4420-9910-c627297ea32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:33.327119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:33.477197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:33.478700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:33.589687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:33.627438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4efb2-0303-4047-93e2-14a68085e2bb None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:33.737481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:33.738089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:33.738366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:33.738634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:33.740262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:33.815313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:33.829594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:33.831195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf91efe-86a7-4688-aeba-9addb29d8841 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:33.849450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 719/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:34.728323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:34.728851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:34.728851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:34.730199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:34.735599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf25aa5-9c4b-462f-b4cc-4e6ecc5e0fab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:34.736099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf25aa5-9c4b-462f-b4cc-4e6ecc5e0fab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:34.736202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf25aa5-9c4b-462f-b4cc-4e6ecc5e0fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:34.812022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-edf25aa5-9c4b-462f-b4cc-4e6ecc5e0fab None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:34.813218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-edf25aa5-9c4b-462f-b4cc-4e6ecc5e0fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:34.908037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:35.058819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:35.060266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:35.142732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:35.205183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49cdbd-e2f6-4858-9948-c3f37d11e4b2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:35.318190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:35.318701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:35.318981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:35.319253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:35.321001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:35.370011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:35.412423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:35.414035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b645e0b-ac63-4548-a478-a31dca5edf6a service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:35.431528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 708/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:36.243232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:36.243838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:36.243838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:36.245144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:36.249912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59846ee1-4406-4fe5-99b5-3f8a03ac7a43 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:36.250325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59846ee1-4406-4fe5-99b5-3f8a03ac7a43 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:36.250469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59846ee1-4406-4fe5-99b5-3f8a03ac7a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:36.327238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-59846ee1-4406-4fe5-99b5-3f8a03ac7a43 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:36.328481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-59846ee1-4406-4fe5-99b5-3f8a03ac7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:36.425858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:36.574995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:36.576516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:36.625986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:36.723758 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae850-dfcd-4995-aca8-c9402b310829 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:36.835277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:36.835853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:36.836156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:36.836429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:36.838058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:36.845565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:36.926985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:36.928620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cda99f-b7a2-44a5-a7ac-009c22c4f4af service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:36.946309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 722/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:37.744458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:37.745006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:37.745006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:37.746288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:37.751268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b2a1-b929-419a-8405-b9725a26f735 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:37.751681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b2a1-b929-419a-8405-b9725a26f735 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:37.751851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b2a1-b929-419a-8405-b9725a26f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:37.829582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-23a5b2a1-b929-419a-8405-b9725a26f735 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:37.830826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-23a5b2a1-b929-419a-8405-b9725a26f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:37.897383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:37.926784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:38.075294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:38.077338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:38.094493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:38.222700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7aee9-095e-47b3-930c-a8d2afae35b5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:38.312006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:38.338821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:38.341012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:38.341012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:38.341012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:38.341614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:38.430671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:38.432326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9819d-0134-4e58-9255-297820bcee4d service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:38.450723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 711/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:39.275813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:39.276352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:39.276352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:39.277741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:39.284116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3abb6-b49b-4574-bdd4-3fd7a15d2ac7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:39.284546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3abb6-b49b-4574-bdd4-3fd7a15d2ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:39.284803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3abb6-b49b-4574-bdd4-3fd7a15d2ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:39.360289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-55f3abb6-b49b-4574-bdd4-3fd7a15d2ac7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:39.361498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-55f3abb6-b49b-4574-bdd4-3fd7a15d2ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:39.403098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:39.458192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:39.607546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:39.609007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:39.754442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b49ea-39ad-4d27-a8a8-7278efe24479 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:39.809641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:39.867691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:39.868267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:39.868545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:39.868817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:39.870425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:39.958525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:39.960168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f0fd-161e-41eb-8f2b-dc3972898bbc service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:39.978277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 725/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:40.777032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:40.777606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:40.777606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:40.778883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:40.786165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd80ae-44d5-48e4-a66f-23fa8719cf72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:40.786613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd80ae-44d5-48e4-a66f-23fa8719cf72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:40.786724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd80ae-44d5-48e4-a66f-23fa8719cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:40.861208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-66bd80ae-44d5-48e4-a66f-23fa8719cf72 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:40.862421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-66bd80ae-44d5-48e4-a66f-23fa8719cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:40.864444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:40.958641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:41.109301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:41.110807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:41.255649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0154d80-f6e7-481b-9f2a-52225c5dfe27 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:41.282673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:41.368830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:41.369374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:41.369655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:41.369929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:41.371577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:41.460362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:41.462087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c42ae9-6d41-4eb4-9ce8-3576f3edd5a0 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:41.480329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 714/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:43.390160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:43.390739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:43.390739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:43.392113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:43.397485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253175-c3b2-4562-b826-2bada0396929 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:43.397485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253175-c3b2-4562-b826-2bada0396929 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:43.398050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7253175-c3b2-4562-b826-2bada0396929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:43.440003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:43.469076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e7253175-c3b2-4562-b826-2bada0396929 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:43.470293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e7253175-c3b2-4562-b826-2bada0396929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:43.567547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:43.607029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:43.608596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:43.709267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3158-1f59-4336-a152-1fe755753912 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:43.740346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:43.781462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:43.782086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:43.782362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:43.782630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:43.784258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:43.890708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:43.892190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124bef4-9419-422d-a1e6-10efb7bd5de4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:43.911131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 728/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:46.144572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:46.145144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:46.145144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:46.146550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:46.151768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3ba5-bee6-4e1f-9ce4-b61e57a4b3ad None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:46.152168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3ba5-bee6-4e1f-9ce4-b61e57a4b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:46.152326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3ba5-bee6-4e1f-9ce4-b61e57a4b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:46.217785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cdef3ba5-bee6-4e1f-9ce4-b61e57a4b3ad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:46.218926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cdef3ba5-bee6-4e1f-9ce4-b61e57a4b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:46.231650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:46.316584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:46.355522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:46.357147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:46.461390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c651-94a2-489a-b40a-2a956eff6cd3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:46.474003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:46.540218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:46.540844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:46.541128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:46.541407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:46.543051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:46.651002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:46.652489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e65fe-88bd-41c1-a19a-efc7abe7c188 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:46.671684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 717/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:49.054560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:49.055204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:49.055204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:49.056499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:49.061636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802838-17e0-4af8-95e6-c9852a465062 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:49.062072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802838-17e0-4af8-95e6-c9852a465062 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:49.062204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802838-17e0-4af8-95e6-c9852a465062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:49.110190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:49.128124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-77802838-17e0-4af8-95e6-c9852a465062 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:49.129317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-77802838-17e0-4af8-95e6-c9852a465062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:49.224789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:49.263418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:49.265489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:49.367165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff071011-113f-453e-a14f-38184c68a5d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:49.406380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:49.439309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:49.439952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:49.440236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:49.440512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:49.442125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:49.551430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:49.553435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec5f32-31e1-4393-a84b-82244bad3f93 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:49.572586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 731/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:51.712748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:51.713326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:51.713326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:51.714737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:52:51.720730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48910-cc4d-4a27-927e-0859d90f2e06 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:51.721144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48910-cc4d-4a27-927e-0859d90f2e06 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:51.721290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc48910-cc4d-4a27-927e-0859d90f2e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:51.787018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5dc48910-cc4d-4a27-927e-0859d90f2e06 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:51.788254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5dc48910-cc4d-4a27-927e-0859d90f2e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:51.808218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:51.882836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:51.923114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:51.924702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:52.028536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497449dd-1cbd-49c7-989a-1994ec1082d4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:52.048534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:52.102958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:52.103576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:52.103889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:52.104162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:52.105778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:52.215319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:52.216882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2102-71f2-44d8-a208-cf0ed19aa801 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:52.235090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 720/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:54.329623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:54.330189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:54.330189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:54.331479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:54.336666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7337-511a-4bc3-acc9-fb44494790f9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:54.337091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7337-511a-4bc3-acc9-fb44494790f9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:54.337226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab7337-511a-4bc3-acc9-fb44494790f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:54.401958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:54.404810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4cab7337-511a-4bc3-acc9-fb44494790f9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:54.406643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4cab7337-511a-4bc3-acc9-fb44494790f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:54.503360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:54.541932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:54.543461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:54.648679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38278e0d-9ff5-4544-9bb8-cd269660af1e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:54.696467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:54.721022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:54.721639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:54.721920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:54.722194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:54.723837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:54.830352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:54.831808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86019806-aae2-40d4-90c4-42fe4fdc368d service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:54.850436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 734/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:56.894465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:56.895025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:56.895025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:56.896355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 20:52:56.902038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaa9b-553c-4a25-b461-1bb40d23f444 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:56.902481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaa9b-553c-4a25-b461-1bb40d23f444 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:56.902614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baaa9b-553c-4a25-b461-1bb40d23f444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:56.968524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-40baaa9b-553c-4a25-b461-1bb40d23f444 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:56.969738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-40baaa9b-553c-4a25-b461-1bb40d23f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:56.999613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:57.067257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:57.105705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:57.107254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:57.210691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42c7e-41f2-434a-a9a9-2489b678ca8f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:57.238026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:57.283590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:57.284309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:57.284594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:57.284871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:57.286769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:57.395075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:52:57.396550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4942580-b0df-47f2-9061-a0f11d6f9f2d service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:52:57.414482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 723/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:52:59.544727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:59.545365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:59.545365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:59.547264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:52:59.552348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0eab-f7fe-4799-b456-8e2008d6b8c0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:59.552745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0eab-f7fe-4799-b456-8e2008d6b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:59.552901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f0eab-f7fe-4799-b456-8e2008d6b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:59.618713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6a5f0eab-f7fe-4799-b456-8e2008d6b8c0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:52:59.619956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6a5f0eab-f7fe-4799-b456-8e2008d6b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:59.633201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:59.726268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:52:59.763453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:52:59.765545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:52:59.867005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd662e-d7e1-4ac7-beed-62a97532397a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:52:59.922323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:52:59.943389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:52:59.944244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:52:59.944639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:52:59.945012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:52:59.946789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:00.058474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:00.059870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78658b1-7dbc-476f-bf5f-57c58220a1b5 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:00.077694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 737/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:02.114746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:02.115319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:02.115319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:02.116690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:02.122039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08b61-8e4d-40c6-b563-cbd52eb24b7c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:02.122510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08b61-8e4d-40c6-b563-cbd52eb24b7c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:02.122619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08b61-8e4d-40c6-b563-cbd52eb24b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:02.189306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-62d08b61-8e4d-40c6-b563-cbd52eb24b7c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:02.190532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-62d08b61-8e4d-40c6-b563-cbd52eb24b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:02.227557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:02.285019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:02.323306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:02.324952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:02.427226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81574a57-da60-4018-9781-58b4b08c5e46 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:02.464011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:02.501696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:02.502242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:02.502522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:02.502795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:02.504477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:02.615250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:02.616736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2d089-6b2c-4399-b809-b7bcba2dfb31 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:02.634764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 726/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:04.663681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:04.664351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:04.664351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:04.665742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:04.671867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ac3-2260-4877-9e83-176c1d7d9311 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:04.672349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ac3-2260-4877-9e83-176c1d7d9311 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:04.672449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442ac3-2260-4877-9e83-176c1d7d9311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:04.737819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2f442ac3-2260-4877-9e83-176c1d7d9311 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:04.738925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2f442ac3-2260-4877-9e83-176c1d7d9311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:04.756547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:04.837342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:04.874232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:04.875774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:04.978533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6cd99-d9c5-4c25-afc7-10f2c5d004d8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:05.045695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:05.052779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:05.053391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:05.053672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:05.053946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:05.055552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:05.164384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:05.165824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a91cd2-87d3-4331-95ac-a005ad369ac1 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:05.183471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 740/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:07.216265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:07.216929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:07.216929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:07.218235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:07.223527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17534f8-504f-4528-b04b-2d7eb4cd0dbe None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:07.223975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17534f8-504f-4528-b04b-2d7eb4cd0dbe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:07.224115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17534f8-504f-4528-b04b-2d7eb4cd0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:07.289773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e17534f8-504f-4528-b04b-2d7eb4cd0dbe None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:07.290972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e17534f8-504f-4528-b04b-2d7eb4cd0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:07.339510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:07.388754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:07.425886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:07.427448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:07.655106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e96eb-001b-4879-bf42-9f81e5f96e1a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:07.702746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:07.728845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:07.729487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:07.729766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:07.730037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:07.731692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:07.848256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:07.849631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ed39-9f5b-42fc-9fe2-dedca48c68bd service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:07.867264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 729/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:17.386933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=22 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:17.864978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=66 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:27.313659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c9d-fb9e-4ebe-92ac-8d72630ea45c None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:27.314215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c9d-fb9e-4ebe-92ac-8d72630ea45c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:27.314215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68438c9d-fb9e-4ebe-92ac-8d72630ea45c None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:27.315595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 742/1471] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:27.320706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22a8f-5bc8-4769-9bc4-73ceab2795b5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:27.321143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22a8f-5bc8-4769-9bc4-73ceab2795b5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:27.321242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22a8f-5bc8-4769-9bc4-73ceab2795b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:27.386247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a9c22a8f-5bc8-4769-9bc4-73ceab2795b5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:27.387433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a9c22a8f-5bc8-4769-9bc4-73ceab2795b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:27.483809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 730/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:27.566626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:27.566855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:27.567134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:27.568524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 743/1473] 10.222.0.45 () {54 vars in 966 bytes} [Thu Aug 4 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:27.573407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df422-a6a4-4a07-9e8c-f589193b839d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:27.573724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df422-a6a4-4a07-9e8c-f589193b839d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:27.574006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df422-a6a4-4a07-9e8c-f589193b839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:27.649588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a03df422-a6a4-4a07-9e8c-f589193b839d None None] MFA Rules not processed for user `c49b3e48a8784ac5894e8399a737f3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:27.650795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a03df422-a6a4-4a07-9e8c-f589193b839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:27.671677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:27.725718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 731/1474] 10.222.0.45 () {58 vars in 1063 bytes} [Thu Aug 4 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:27.733764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:27.735263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:27.842841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cbbfc-a96b-497c-8bf9-b4002caa4a2a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:27.915506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:27.916151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:27.916432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:27.916706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:27.918321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:27.971356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:28.026176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:28.027631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a8e98-ee5f-438c-a31e-e0d1bcfffc0b service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:28.048030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 744/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:53:30.148447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:30.148989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:30.148989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:30.150350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 732/1476] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:30.155615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587aee-b6eb-4031-bce6-989208b1d43c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:30.156098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587aee-b6eb-4031-bce6-989208b1d43c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:30.156211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65587aee-b6eb-4031-bce6-989208b1d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:30.221531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-65587aee-b6eb-4031-bce6-989208b1d43c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:30.222732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65587aee-b6eb-4031-bce6-989208b1d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:30.318738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 745/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:30.342528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:30.344078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:30.468429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea445-dde3-4e3f-9140-9125d98136e2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:30.516432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:30.561358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:30.561975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:30.562254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:30.562524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:30.563215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:30.564961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:53:30.564961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:53:30.564961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:53:30.566089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf53f0e-a0fd-48bd-a932-055a7e656238 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:30.584254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 733/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 4 20:53:30 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:53:32.609338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:32.609914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:32.610022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:32.611362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 746/1479] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:32.616680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38823-0a01-4ed5-bda5-ae2ac9fa6797 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:32.617113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38823-0a01-4ed5-bda5-ae2ac9fa6797 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:32.617361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38823-0a01-4ed5-bda5-ae2ac9fa6797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:32.682365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3aa38823-0a01-4ed5-bda5-ae2ac9fa6797 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:32.683606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3aa38823-0a01-4ed5-bda5-ae2ac9fa6797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:32.780133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 734/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:32.823420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:32.824999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:32.834662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:32.970775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcee0f-e609-4c72-b8fb-b4dd22f30650 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:33.050251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:33.083475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:33.084128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:33.084413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:33.084721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:33.086319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:33.175375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:33.177006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7b93-ea37-4d6a-9ce1-edf82da4baf9 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:33.194737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 747/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:35.377849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:35.378435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:35.378435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:35.379797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 735/1482] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:35.385030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9d5d-7ab0-44d5-88da-96002117b964 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:35.385446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9d5d-7ab0-44d5-88da-96002117b964 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:35.385593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9d5d-7ab0-44d5-88da-96002117b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:35.452782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-87bf9d5d-7ab0-44d5-88da-96002117b964 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:35.454027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-87bf9d5d-7ab0-44d5-88da-96002117b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:35.500514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:35.549554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 748/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:35.585468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:35.587029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:35.611213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:35.690444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eba157-ced6-4a62-baf7-7f677379e576 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:35.763200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:35.763870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:35.764157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:35.764429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:35.766044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:35.840745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:35.876693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:35.878138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e106a-a1e8-49a0-be81-7955d5289d8c service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:35.895735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 736/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:37.973555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:37.974161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:37.974161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:37.975460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 749/1485] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:37.980711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d1ad-e29a-41a6-8efe-86d73176148f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:37.981145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d1ad-e29a-41a6-8efe-86d73176148f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:37.981279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431d1ad-e29a-41a6-8efe-86d73176148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:38.047908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a431d1ad-e29a-41a6-8efe-86d73176148f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:38.049162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a431d1ad-e29a-41a6-8efe-86d73176148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:38.144021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 737/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:38.185532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:38.187587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:38.288714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3abbba-e80d-4051-b201-66b196c3fe11 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:38.359597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:38.361583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:38.362216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:38.362661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:38.362996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:38.365065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:38.473044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:38.474509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92e4e-a3b5-4a4e-bc33-5b7ac57d5f06 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:38.493099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 750/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:40.611310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:40.611901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:40.611901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:40.613280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 738/1488] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:40.618662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479311e-0a67-4292-be41-ea7e5f3cfa8b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:40.619084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479311e-0a67-4292-be41-ea7e5f3cfa8b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:40.619219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479311e-0a67-4292-be41-ea7e5f3cfa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:40.685034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7479311e-0a67-4292-be41-ea7e5f3cfa8b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:40.686231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7479311e-0a67-4292-be41-ea7e5f3cfa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:40.738810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:40.782728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 751/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:40.824241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:40.825759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:40.861439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:40.937914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd706d-bcdb-4fee-9d1d-d736c8f48f76 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:41.011786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:41.012334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:41.012612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:41.012906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:41.014591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:41.095859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:41.125195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:41.126642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2145-7599-4139-9852-1fe516d74aab service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:41.145020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 739/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:43.325599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:43.326184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:43.326184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:43.328143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 752/1491] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 4 20:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:53:43.333199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c2a4-6bbf-4ac9-a6bb-982f682d74b9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:43.333651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c2a4-6bbf-4ac9-a6bb-982f682d74b9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:43.333757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c2a4-6bbf-4ac9-a6bb-982f682d74b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:43.405083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-78b6c2a4-6bbf-4ac9-a6bb-982f682d74b9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:53:43.406390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-78b6c2a4-6bbf-4ac9-a6bb-982f682d74b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:43.503276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 740/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 4 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:53:43.543328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:53:43.544887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:43.648116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d76032-5528-429d-be00-5e219a1b8dff None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:53:43.719676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:53:43.720478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:53:43.720772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:53:43.721050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:53:43.722662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:53:43.731676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:43.831659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:53:43.833133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda1d4c-d8cd-426c-aaeb-e78eba3e417e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:53:43.851093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 753/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:53:53.501447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=82 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:53:53.848876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=50 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:59.454188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:54:59.454802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:54:59.454802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:54:59.532228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:54:59.533430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:54:59.632737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 741/1494] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:54:59.640869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:54:59.641368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:54:59.641474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:54:59.717160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:54:59.718292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:54:59.815164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 754/1495] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:54:59.819861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:54:59.821141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:54:59.832535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5e863-3111-4601-9672-778c6c0feab3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:54:59.893437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:54:59.927504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:54:59.928155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:54:59.928440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:54:59.928716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:54:59.929409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:54:59.929715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:54:59.930733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:54:59.930733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:54:59.930733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:54:59.931614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:54:59.943080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 742/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:54:59.952147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:54:59.961197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef65f-8710-4c99-a88e-e9b257e5ea70 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:00.026600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:00.067012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:00.067734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.068098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.068377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.069092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:00.070903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:00.070903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:55:00.070903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:55:00.072425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:00.133806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 755/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:54:59 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:55:00.138972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:00.140741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:00.178193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce878e0-b751-457c-b894-b086ee6e3d98 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:00.271537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:00.272176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.272457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.272731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.273390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:00.274400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:00.274400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:55:00.274400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:55:00.275611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:00.317273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 743/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:55:00 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:55:00.321252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:00.322832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:00.385540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161b2a-372e-4bde-b847-842f72fda339 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:00.470040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:00.481675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:00.482292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.482573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.482847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.483542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:00.484610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:00.484610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:55:00.484610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:55:00.486539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:00.499318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 756/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:55:00.503366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:00.504962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:00.516909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdd24f-6dbf-484b-a6ab-70ae2ce613a3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:00.541649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:00.614350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:00.614893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.615175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.615450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.616184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:00.617201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:00.617201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:55:00.617201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:55:00.618091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cc707-ebfd-4c4c-86a4-40dbb38f0d3a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:00.630779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 744/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:55:00.635045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:00.636646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:00.669857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05794bde-80ba-44c0-a47b-ca528b4ba5a3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:00.760924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:00.761588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.761874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.762154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] PATH_INFO: `/v3/projects/3104c2e49d0b405caab7b0b5ac3e217f/users/167cb6b8c6bc4415bd3010ce6d0219d5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.785621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3104c2e49d0b405caab7b0b5ac3e217f, user_id=167cb6b8c6bc4415bd3010ce6d0219d5, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:00.786642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:00.786642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:55:00.786642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:55:00.788880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b2af5-6c60-4679-b8b4-125a997a6b03 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:00.813094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 757/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:55:00 2022] PUT /identity/v3/projects/3104c2e49d0b405caab7b0b5ac3e217f/users/167cb6b8c6bc4415bd3010ce6d0219d5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:55:00.825131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7ae8-6ca2-4520-9405-c152d1f746ce None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.825420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7ae8-6ca2-4520-9405-c152d1f746ce None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.825726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7ae8-6ca2-4520-9405-c152d1f746ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.882740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9daf7ae8-6ca2-4520-9405-c152d1f746ce None None] MFA Rules not processed for user `167cb6b8c6bc4415bd3010ce6d0219d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:55:00.883898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9daf7ae8-6ca2-4520-9405-c152d1f746ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:00.973922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 745/1502] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:55:00.988382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.988671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.988949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:00.991219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 758/1503] 10.222.0.45 () {54 vars in 964 bytes} [Thu Aug 4 20:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:55:00.996400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5345-e0bc-472a-ae2f-f352cf57e4f6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:00.996692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5345-e0bc-472a-ae2f-f352cf57e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:00.996982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5345-e0bc-472a-ae2f-f352cf57e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:01.029563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:01.077588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e9ff5345-e0bc-472a-ae2f-f352cf57e4f6 None None] MFA Rules not processed for user `31f9af670ced484a8c829f245bd08ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:55:01.078797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e9ff5345-e0bc-472a-ae2f-f352cf57e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:01.156114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 746/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Aug 4 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:55:01.165561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:01.167071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:01.227228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:01.281319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958c8d6-25f1-47b3-a7b1-fe01382b172f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:01.355544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:01.356187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:01.356465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:01.356735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:01.358338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:01.458504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:01.459988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:01.463461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:01.478844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 759/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:55:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:55:01.523618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35160bf4-4e24-4138-9e2b-932a2875dd8e None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:01.524067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35160bf4-4e24-4138-9e2b-932a2875dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:01.524229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35160bf4-4e24-4138-9e2b-932a2875dd8e None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:01.525521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 747/1506] 10.222.0.45 () {52 vars in 830 bytes} [Thu Aug 4 20:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:55:01.528966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:01.530167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:01.628848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22ce88-30f9-4f14-934f-32fd11c0c74b service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:01.720365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:01.721014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:01.721204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:01.721481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] PATH_INFO: `/v3/users/167cb6b8c6bc4415bd3010ce6d0219d5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:01.734242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] RBAC: Authorizing `identity:delete_user(user_id=167cb6b8c6bc4415bd3010ce6d0219d5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:01.735293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:01.735293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:55:01.735293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:55:01.736578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:01.746298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:01.804658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167cb6b8c6bc4415bd3010ce6d0219d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:01.805093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167cb6b8c6bc4415bd3010ce6d0219d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:01.815272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167cb6b8c6bc4415bd3010ce6d0219d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:01.828965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167cb6b8c6bc4415bd3010ce6d0219d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:01.851184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167cb6b8c6bc4415bd3010ce6d0219d5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:01.857316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 760/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:55:01 2022] DELETE /identity/v3/users/167cb6b8c6bc4415bd3010ce6d0219d5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:55:01.861797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:01.862094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:01.862378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:01.918461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:55:01.920240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:01.995738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:02.008599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 748/1508] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:55:02.018135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:02.019343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:02.120965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147cc2a-d672-419d-ab71-7a949ec1262d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:02.177520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:02.197852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:02.198475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:02.198757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:02.199039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:02.200728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:02.307473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:02.308864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296db65-1e88-4e70-8532-d9fbd79f94f0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:02.326986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 761/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:55:02.715294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:55:02.717208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:55:02.729025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508605e5-d3e4-4074-91fc-8d8cce214c3a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:55:02.828390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:55:02.829032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:55:02.829310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:55:02.829585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] PATH_INFO: `/v3/projects/3104c2e49d0b405caab7b0b5ac3e217f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:55:02.839422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3104c2e49d0b405caab7b0b5ac3e217f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:55:02.840424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:55:02.840424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:55:02.840424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:55:02.841649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:55:02.899000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3104c2e49d0b405caab7b0b5ac3e217f', 'request_id': 'req-57f901e2-02d0-451e-a04f-40f7a0f3d021'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:02.908971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3104c2e49d0b405caab7b0b5ac3e217f', 'request_id': 'req-57f901e2-02d0-451e-a04f-40f7a0f3d021'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:02.915874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3104c2e49d0b405caab7b0b5ac3e217f', 'request_id': 'req-57f901e2-02d0-451e-a04f-40f7a0f3d021'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:02.945640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] The token cache is being invalidate because project 3104c2e49d0b405caab7b0b5ac3e217f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:55:02.945926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:02.946356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57f901e2-02d0-451e-a04f-40f7a0f3d021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:55:02.948242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 749/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:55:02 2022] DELETE /identity/v3/projects/3104c2e49d0b405caab7b0b5ac3e217f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:55:12.324795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=62 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:55:12.943456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:40.188165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:40.188812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:40.188812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:40.190109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:40.194946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114473-8bd2-4ee0-b78c-696e80d1515b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:40.195660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114473-8bd2-4ee0-b78c-696e80d1515b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:40.195948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114473-8bd2-4ee0-b78c-696e80d1515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:40.277584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3b114473-8bd2-4ee0-b78c-696e80d1515b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:40.278795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3b114473-8bd2-4ee0-b78c-696e80d1515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:40.381410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:40.534232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:40.536496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:40.656225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb51e-c1ff-46cf-b629-b1eb71d734a0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:40.661664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:40.662280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:40.662565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:40.663100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:40.671691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:40.673301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5435507-ef60-4db1-8fcc-776d26998388 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:40.682689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 763/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:56:41.516337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4385-ad4a-4e11-beb4-8e3979d7311f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:41.516838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4385-ad4a-4e11-beb4-8e3979d7311f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:41.516948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4385-ad4a-4e11-beb4-8e3979d7311f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:41.518278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:41.523191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829051-2622-49e1-98a9-572e13eb129b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:41.523606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829051-2622-49e1-98a9-572e13eb129b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:41.523738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829051-2622-49e1-98a9-572e13eb129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:41.543492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a7829051-2622-49e1-98a9-572e13eb129b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:41.544706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a7829051-2622-49e1-98a9-572e13eb129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:41.552463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:41.705754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4385-ad4a-4e11-beb4-8e3979d7311f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:41.720239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4385-ad4a-4e11-beb4-8e3979d7311f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:41.725527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:41.726137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:41.726423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:41.726703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:41.734927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:41.736584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7db22-9b6e-4ffa-ae93-7b093f21258d service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:41.746432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 752/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:56:42.088302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002a54-40b0-4cbc-afda-8e9b22a0cf5e None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:42.088631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002a54-40b0-4cbc-afda-8e9b22a0cf5e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:42.088879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0002a54-40b0-4cbc-afda-8e9b22a0cf5e None None] PATH_INFO: `/v3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:42.090252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 765/1517] 10.222.0.18 () {54 vars in 925 bytes} [Thu Aug 4 20:56:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:56:42.096413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15917f4-3612-421a-8fc3-d36451a87246 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:42.096701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15917f4-3612-421a-8fc3-d36451a87246 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:42.096976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15917f4-3612-421a-8fc3-d36451a87246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:42.155150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d15917f4-3612-421a-8fc3-d36451a87246 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:42.156380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d15917f4-3612-421a-8fc3-d36451a87246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:42.174242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:56:42.231652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 753/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Aug 4 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:56:46.245843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84efc-e376-4eca-8ba1-1b0e8bdb2799 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:46.246409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84efc-e376-4eca-8ba1-1b0e8bdb2799 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:46.246409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d84efc-e376-4eca-8ba1-1b0e8bdb2799 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:46.248451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 766/1519] 10.222.0.45 () {54 vars in 961 bytes} [Thu Aug 4 20:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:46.253926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4df1a-a36d-4380-9421-1376cdea831d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:46.254349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4df1a-a36d-4380-9421-1376cdea831d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:46.254480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4df1a-a36d-4380-9421-1376cdea831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:46.275116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c0e4df1a-a36d-4380-9421-1376cdea831d None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:46.276354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c0e4df1a-a36d-4380-9421-1376cdea831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:46.285343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 754/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Aug 4 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:46.292911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d84efc-e376-4eca-8ba1-1b0e8bdb2799 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:46.306070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d84efc-e376-4eca-8ba1-1b0e8bdb2799 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:46.311695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:46.312450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:46.312730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:46.313106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:46.322213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:46.323825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5e938-521d-4595-bd9a-eb343bc468a1 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:46.333854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 767/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:56:52.981566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a0c1-78cf-49a6-bbc0-e266ddf15ab0 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:52.982118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a0c1-78cf-49a6-bbc0-e266ddf15ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:52.982118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76a0c1-78cf-49a6-bbc0-e266ddf15ab0 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:52.983537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:52.988310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00917-1d8e-450a-9935-6b80a7a066f7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:52.988741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00917-1d8e-450a-9935-6b80a7a066f7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:52.988869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f00917-1d8e-450a-9935-6b80a7a066f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:53.008934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-76f00917-1d8e-450a-9935-6b80a7a066f7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:53.010137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-76f00917-1d8e-450a-9935-6b80a7a066f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:53.018596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:53.174572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a0c1-78cf-49a6-bbc0-e266ddf15ab0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:53.189347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76a0c1-78cf-49a6-bbc0-e266ddf15ab0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:53.194730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:53.195346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:53.195629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:53.195937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:53.204362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:53.205950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569a808-579a-4050-9bc9-ede2e9482c55 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:53.215206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 756/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:56:54.047201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54a15-d890-4e97-aa11-36838593b705 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:54.047782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54a15-d890-4e97-aa11-36838593b705 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:54.047782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa54a15-d890-4e97-aa11-36838593b705 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:54.049205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 20:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:54.054010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750605-5088-4bf1-a5d2-1f25b80e8697 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:54.054454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750605-5088-4bf1-a5d2-1f25b80e8697 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:54.054568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7750605-5088-4bf1-a5d2-1f25b80e8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:54.073807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a7750605-5088-4bf1-a5d2-1f25b80e8697 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:54.075008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a7750605-5088-4bf1-a5d2-1f25b80e8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:54.083420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:54.236852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54a15-d890-4e97-aa11-36838593b705 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:54.251491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa54a15-d890-4e97-aa11-36838593b705 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:54.257964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:54.258562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:54.258843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:54.259117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:54.267149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:54.268754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5954-fe8e-4a76-86dc-610950172890 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:54.277997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 770/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:56:58.197253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:58.197788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:58.197788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:58.199178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:56:58.204438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40eb92-8dab-47cc-833a-62454d83c4c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:58.204859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40eb92-8dab-47cc-833a-62454d83c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:58.205002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40eb92-8dab-47cc-833a-62454d83c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:58.224295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7b40eb92-8dab-47cc-833a-62454d83c4c2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:56:58.225478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7b40eb92-8dab-47cc-833a-62454d83c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:58.233711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:56:58.306322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:56:58.308252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:56:58.386856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d22e04-23b5-41f0-93c3-823c7d995440 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:56:58.390334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:56:58.390950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:56:58.391233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:56:58.391508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:56:58.400334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:56:58.401778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af22e3-9727-4eba-9f49-bf02ace4f3ef service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:56:58.411548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 759/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:57:00.408423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:00.408965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:00.408965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:00.410261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:57:00.415609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42427-91d3-4cd6-b291-d964294df486 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:00.416024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42427-91d3-4cd6-b291-d964294df486 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:00.416208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42427-91d3-4cd6-b291-d964294df486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:00.435945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e7b42427-91d3-4cd6-b291-d964294df486 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:57:00.437148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e7b42427-91d3-4cd6-b291-d964294df486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:00.444932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:57:00.481251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:57:00.482921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:00.495798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9392-2ab3-4c25-ab14-b51e38313569 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:57:00.499913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:57:00.500520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:00.500811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:00.501090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:00.510223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:57:00.511644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587119c9-5fe9-4607-9207-def6df45ab3c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:57:00.521626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 773/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:57:04.183073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:04.183820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:04.183820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:04.185581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:57:04.190827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408288-121a-4082-bbf2-fad60a1ca289 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:04.191295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408288-121a-4082-bbf2-fad60a1ca289 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:04.191404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a408288-121a-4082-bbf2-fad60a1ca289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:04.199026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:04.212096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9a408288-121a-4082-bbf2-fad60a1ca289 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:57:04.213297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9a408288-121a-4082-bbf2-fad60a1ca289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:04.221145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:57:04.524471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:57:04.526147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:04.589841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:04.603502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63ada-92d1-4167-94df-751a355e419f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:57:04.607592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:57:04.608239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:04.608525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:04.608802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:04.617655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:57:04.619095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e94ce-b76f-4ce0-aee0-627c73a5c754 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:57:04.629061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 762/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:57:06.629189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:06.629729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:06.629842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:06.631146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 20:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:57:06.636161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da3c-6acd-4531-9106-0d287221937d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:06.636577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da3c-6acd-4531-9106-0d287221937d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:06.636705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73da3c-6acd-4531-9106-0d287221937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:06.656201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1f73da3c-6acd-4531-9106-0d287221937d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:57:06.657378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f73da3c-6acd-4531-9106-0d287221937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:06.665268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:57:06.968134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:57:06.969877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:57:06.982908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f60a54-5608-4835-886c-135d3f0e4cb7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:57:06.986414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:57:06.987019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:57:06.987301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:57:06.987577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:57:06.996387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:57:06.997814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a509a-0282-4263-ab05-dc5cc43844e7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:57:07.007013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 776/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:57:16.650996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=11 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:57:17.002939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:34.555033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.556092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.556553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.579361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:34.585050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:34.599014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 764/1540] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:34.607890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.609246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.609246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.635121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:34.640750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:34.655978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 777/1541] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:58:34.661401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:34.681475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0e53a-7a20-4833-8dd8-57396cbfb545 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:34.692119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:34.693433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.693774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.694057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.694808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:34.695290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:34.697086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:34.715200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 765/1542] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:34.724111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:34.738113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f24668-6d45-4c21-a2db-dabd4519eba7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:34.743878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:34.744525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.744808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.745085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.745770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:34.747689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738cddf-b619-4d04-8600-acc6892ec796 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:34.803210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 778/1543] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:34.807535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:34.823890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2382d6e-2495-443e-9bc9-963ec2a07def admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:34.902932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:34.903574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.903879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.904155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.904836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:34.906799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba81d0-909b-4330-b4a3-9f2c8d5c840e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:34.909753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.910046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.910329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.935106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 766/1544] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:34.942842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:34.944094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:34.946261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b4d7-4770-46f0-8703-c8ea1c4540ad None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.946555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b4d7-4770-46f0-8703-c8ea1c4540ad None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.946832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6b4d7-4770-46f0-8703-c8ea1c4540ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.959697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 779/1545] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:34.960582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:34.975660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c59-1899-4255-bed3-66a6163c02c4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:34.984093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1ab6b4d7-4770-46f0-8703-c8ea1c4540ad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:34.985672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1ab6b4d7-4770-46f0-8703-c8ea1c4540ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:34.986338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:34.986998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:34.987269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:34.987534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:34.991776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:34.991776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4c271-1b4b-4fda-b0d8-fa4f039383ad admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.006046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 780/1546] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:35.007337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030d47-0121-4a29-bfcd-9061ac12f3e3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.007626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030d47-0121-4a29-bfcd-9061ac12f3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.007932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030d47-0121-4a29-bfcd-9061ac12f3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.016421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 767/1547] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.020338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.021235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.021521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.051179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f8030d47-0121-4a29-bfcd-9061ac12f3e3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.052502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8030d47-0121-4a29-bfcd-9061ac12f3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.065196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 781/1548] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.065411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.066685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.066825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567014fe-5a4b-47b0-b825-190f08a9cd18 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.067001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567014fe-5a4b-47b0-b825-190f08a9cd18 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.067288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567014fe-5a4b-47b0-b825-190f08a9cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.075049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 768/1549] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.076008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.087266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7df56-a4e3-472b-86b4-3b574570be07 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.089411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-567014fe-5a4b-47b0-b825-190f08a9cd18 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.090684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-567014fe-5a4b-47b0-b825-190f08a9cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.092312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.093142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.093428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.093701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.094401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.096787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41568f-119a-4905-a9ed-a3a7ddd932de admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.099824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 782/1550] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.101046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904016-d8e8-430e-92f9-fdb68aea0cc6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.101339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904016-d8e8-430e-92f9-fdb68aea0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.101618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904016-d8e8-430e-92f9-fdb68aea0cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.112569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 769/1551] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:35.113812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f67a8-e8d8-4165-9756-581307de0df4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.114108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f67a8-e8d8-4165-9756-581307de0df4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.114389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f67a8-e8d8-4165-9756-581307de0df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.120767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-73904016-d8e8-430e-92f9-fdb68aea0cc6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.121967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-73904016-d8e8-430e-92f9-fdb68aea0cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.130419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 783/1552] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.131615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.131934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.132212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.134326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4d1f67a8-e8d8-4165-9756-581307de0df4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.135561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4d1f67a8-e8d8-4165-9756-581307de0df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.144174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 770/1553] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.145358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c42ab-af71-4a13-a2a0-33569c0d2664 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.145646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c42ab-af71-4a13-a2a0-33569c0d2664 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.145922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c42ab-af71-4a13-a2a0-33569c0d2664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.156990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.158497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.166373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cc9c42ab-af71-4a13-a2a0-33569c0d2664 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.167455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 784/1554] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.174926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cc9c42ab-af71-4a13-a2a0-33569c0d2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.175066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.176706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 771/1555] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.178044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ffd79-c178-4718-bbf8-abe6eadff602 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.178180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.178285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.178566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.185681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.186542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.186821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.187100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.187832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.188298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.189877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:35.189877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:58:35.189877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:58:35.190772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5c5d-2c73-4231-9f1a-ff5ae12c406e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.200401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.201720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.203531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 785/1556] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.205459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.205746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.206022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.215722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 772/1557] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.216553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.225782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f415628-6b6b-4361-ba02-afb3940ad706 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.227036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.228251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.230389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.231045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.231327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.231605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] PATH_INFO: `/v3/projects/35774fc25d4a4023bf913644842858e7/users/29348f8d69b44ae8bb850408821863fd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.236136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 786/1558] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.236970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.246186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35774fc25d4a4023bf913644842858e7, user_id=29348f8d69b44ae8bb850408821863fd, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.246339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5dd66-0aa3-4a76-afdf-ca9a2625a830 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.247234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:35.247234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:58:35.247234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:58:35.251442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.251644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479f625-0eb9-49ca-838a-37b94f160b4a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.252074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.252352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.252622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.253301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.253598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.255174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7dcbee-f728-4486-a983-61ba7aff1f1f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.265519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 773/1559] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:35 2022] PUT /identity/v3/projects/35774fc25d4a4023bf913644842858e7/users/29348f8d69b44ae8bb850408821863fd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:35.267310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d023cb-e9c3-412d-9f2c-fc87555283cb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.267596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d023cb-e9c3-412d-9f2c-fc87555283cb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.267899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d023cb-e9c3-412d-9f2c-fc87555283cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.278817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 787/1560] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.278817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.278817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.278817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.287215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f0d023cb-e9c3-412d-9f2c-fc87555283cb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.288458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f0d023cb-e9c3-412d-9f2c-fc87555283cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.295422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.296615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.350260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 774/1561] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.351588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.352614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.352895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.359878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 788/1562] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.360584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:35.360725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.371557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54d9ef-f48b-4cbc-ae0e-f45fdd91b263 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.374296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.375558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.376757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.377374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.377657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.377929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.378595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.380515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.384181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 775/1563] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.384960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.394862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728235-ae31-43fa-b5f9-75e6328cc763 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.399571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.400218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.400514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.400857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.401487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.401812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.403535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621da43-ee96-47f8-a895-9ccd4120e5d0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.409806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 789/1564] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.410638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.424505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 776/1565] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.424505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.424505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.424505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.439255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:35.440488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:35.443396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:35.484775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016b23d-c86a-45e3-9b5f-9730369e6c4c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.490570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.491194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.491479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.491775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.492485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.492793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.494440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.506560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 777/1566] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:35.513772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 790/1567] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.514567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.514686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.518854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c624d-f524-4a76-9ce6-d91ffafa496b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.523493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.524140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.524427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.524552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b37f-b2ee-4761-85cd-5ae8c2dfc1d7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.524759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.525800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.526107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.527711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.530345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.530989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.531273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.531550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.532250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.533270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:35.533270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:58:35.533270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:58:35.534444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.540987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 791/1568] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.541864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.552174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41fd53-c932-45e4-af56-f598dd2e66f9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.557485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.558085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.558364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.558636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.559431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.559733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.561341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.563290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 778/1569] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.565581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.580661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 792/1570] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.580661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.587340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe6dae-5ca0-4629-9f22-6ff3fa9783bd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.633708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe489ab-5df2-475f-b76d-c35a22f6c466 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.638389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.639017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.639299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.639573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.640300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:35.640608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.642293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.642742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.643367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.643650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.643953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.644623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.645634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:35.645634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:58:35.645634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:58:35.646846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.653969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 779/1571] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:35.654901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.667532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d24d3-6118-4370-8831-a94a79d77ead admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.674725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 793/1572] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.674725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.674989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.674989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.674989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.674989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.675307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.676534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.682150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223e2e-97c1-4bbf-988e-b6cd9178b0cd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.686745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.687345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.687632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.687943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.689168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.691074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.704905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 780/1573] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.705760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.727967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 794/1574] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.727967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.743148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:35.764909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed59d-2923-4dd2-9720-fd034a0f6be0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.792331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19a4a-812e-4f25-a543-30800b366872 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.797108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.797724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.798533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.798807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.799502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.801487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.805933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:35.817336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.817962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.818245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.818519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.828499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.830100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.830727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 795/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.831535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.840245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 781/1576] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:35.841028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.850601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb187a9-4811-4cfd-a2cd-ed55fec93cc2 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.906953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e7f4-5ce9-4f53-bc10-e1f071969822 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:35.912710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.913341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.913623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.913901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.914008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:35.914577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.914705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:35.914870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:35.915178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:35.916149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:35.916570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.917988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:35.945327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 796/1577] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.945327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.955391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 782/1578] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:35.955391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:35.956977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556084b-001e-4327-9d06-5eb58ca19405 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.028704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923a154-3f89-4538-8a59-7c443559a2d2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.032880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.033511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.033794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.034069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.034954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.035787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.036983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.037125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.037420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.037855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.039436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.042430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.051263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 783/1579] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.051263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.062161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4149de7-906e-416c-b835-70c9bd5b5eb0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.069158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.069350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.069688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.069959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.070850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.073014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.076960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 797/1580] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:35 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.078031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.087854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:36.103187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 784/1581] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/users => generated 286 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.104405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.116210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0da51-3152-4230-9b6e-29c2ebf2fd75 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.154411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ce3be-0247-4054-939e-f1d04529f0d8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.159566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.160294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.160646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.160993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.161998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.164068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.172375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:36.185654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.186371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.186727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.187082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.187868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.190549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.192266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 798/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.196749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.210056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8d4c1-ff41-4c3b-98ce-51f4eec8f03f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.214164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 785/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.215086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.215714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.216030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.216303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.217147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.217870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.218774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.227921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ea9fd-b8f7-4282-9647-b8f2f7236829 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.231959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 799/1584] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.231959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.234827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.236136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.236389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.236760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.237513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.239540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.255050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767773d-1aef-4863-bb5d-06f7b95d3ce6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.261661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.262816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.263161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.263372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.264598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.266339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.268339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 786/1585] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.269371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.286516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdeec54-0b24-4a25-b1c5-b45ff9427206 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.287120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 800/1586] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.287120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.293370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.294074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.294414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.294696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.295633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.295940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb92b-89b9-4385-a50c-154f9c6c1072 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.298673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.301501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.302223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.302504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.302779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.303480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.305154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.321441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 801/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.322125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.340997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 787/1588] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/users => generated 294 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:36.341980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.345046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca3bb4-8893-41fa-ae7b-54555ab5bf7a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.350090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.351321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.351606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.351926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.352648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.354113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff041bd3-ad7c-49fc-bb0c-f7050c6996fb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.354255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.359119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.359761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.360060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.360843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.361572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.363199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.375106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 802/1589] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.379484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 788/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.379663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.380410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.392094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ddad4-07f0-4cab-b67d-8e2ab199bf5f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.392617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795d078-2651-484a-9cb7-ec915e944900 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.397430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.397684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.398203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.398328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.398576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.398688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.398880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.399009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.399610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.399869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.401310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.401606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.413500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 803/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.414828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 789/1592] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.417766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.417905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.428313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac32b2-d6e6-4fb6-8fd7-222235a3f6fc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.432058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666129-020e-4e76-8a08-5d6614a6bb82 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.433580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.434339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.434695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.435042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] PATH_INFO: `/v3/projects/0085179de0474e629a22a84d07968174/users/eb570550f73e4d6a8c87d2bc0c12b4b7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.439102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.439722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.440045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.440320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.441012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.442748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.452346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0085179de0474e629a22a84d07968174, user_id=eb570550f73e4d6a8c87d2bc0c12b4b7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.455343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.456285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 790/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.457231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.468210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6959-80aa-4290-a5ff-60202c0e7a6b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.470550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 804/1594] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/0085179de0474e629a22a84d07968174/users/eb570550f73e4d6a8c87d2bc0c12b4b7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:36.475484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.539911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.540605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.540866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.541157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.541879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.543496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.550151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122bf70-6ba4-4171-b4b0-f4ab9fc70dee admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.557603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 791/1595] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.557804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.557934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.558017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.558017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.558017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.558017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.558619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.569201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7d47b-2cfa-4cdb-80cc-b9cbfca0dceb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.569843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 805/1596] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.570653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.577602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.578636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.579033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.579387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.580190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.581976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.582951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c22e4-fb0f-4752-b4ca-994d204819e7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.588718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.589468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.589822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.590174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] PATH_INFO: `/v3/projects/07a612a0930b43c396ee35b7acafa61c/users/b23a317904864972b875257cfcd90277/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.593395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 792/1597] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.597000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.602543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:36.607401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a612a0930b43c396ee35b7acafa61c, user_id=b23a317904864972b875257cfcd90277, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.609022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949c76b-b5bd-4aec-94e0-cef024cc1317 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.610154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.617429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.618203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.618833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.619305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.620167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.622106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfc87c-36ad-48da-8ff8-709cbe563772 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.627149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 806/1598] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/07a612a0930b43c396ee35b7acafa61c/users/b23a317904864972b875257cfcd90277/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:36.628216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.634291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 793/1599] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.635515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.635830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.636110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.655913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:36.657653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:36.699388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:36.723965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fae550-c523-42d6-a67b-c98524728329 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.731796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 794/1600] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:36.731796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.732330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.732971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.733253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.733580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] PATH_INFO: `/v3/projects/896982ce8af14f5da006e44b34bd2063/users/3a697426bd7842209e709f85405856e8/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.746947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87874e05-f3ee-4b61-bc97-7496b00a294b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.753546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.754245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.754519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.754796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.755515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.757250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.758456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=896982ce8af14f5da006e44b34bd2063, user_id=3a697426bd7842209e709f85405856e8, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.761560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.772367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 795/1601] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:36.772367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.784245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8647c-13a5-4d48-affc-7e5a50ce8b28 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.794819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 807/1602] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/896982ce8af14f5da006e44b34bd2063/users/3a697426bd7842209e709f85405856e8/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:36.794819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.863261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f57b1-7609-4545-ad36-50a984a61f0c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.864334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.865007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.865289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.865653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] PATH_INFO: `/v3/projects/2d334c4e9d7744088bc546d5283bde27/users/ab4b1b421a35490fa717ad21dc46eb97/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.868596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.869468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.869818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.870175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] PATH_INFO: `/v3/projects/71e1ca214b6441efb2717b08466a6fb0/users/71add7accd2045d8868ee78a671327fd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.881254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d334c4e9d7744088bc546d5283bde27, user_id=ab4b1b421a35490fa717ad21dc46eb97, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.883952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307475e-a23a-4cd5-adf3-c54a11d425a6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.886993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e1ca214b6441efb2717b08466a6fb0, user_id=71add7accd2045d8868ee78a671327fd, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:36.890193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:36.901266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 796/1603] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/2d334c4e9d7744088bc546d5283bde27/users/ab4b1b421a35490fa717ad21dc46eb97/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:36.902549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c467e-92fe-4154-9899-b6cb12d2c2f1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.902856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c467e-92fe-4154-9899-b6cb12d2c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.903129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c467e-92fe-4154-9899-b6cb12d2c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.912918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 808/1604] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/71e1ca214b6441efb2717b08466a6fb0/users/71add7accd2045d8868ee78a671327fd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:36.913741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:36.924443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b00c467e-92fe-4154-9899-b6cb12d2c2f1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:36.925642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b00c467e-92fe-4154-9899-b6cb12d2c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:36.977466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f06ba-9db9-4b7a-a378-d62e75058ca1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:36.982354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:36.983035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.983311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.983585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] PATH_INFO: `/v3/projects/ba77ecab7f8d4d2292550b9e2fc4ee38/users/3f639747a95847fa925cb5e6927c59d7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.984914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 797/1605] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:36.986833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:36.987115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:36.987388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:36.995454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:36.999810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba77ecab7f8d4d2292550b9e2fc4ee38, user_id=3f639747a95847fa925cb5e6927c59d7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.002737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.016024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 809/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:36 2022] PUT /identity/v3/projects/ba77ecab7f8d4d2292550b9e2fc4ee38/users/3f639747a95847fa925cb5e6927c59d7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:37.017415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] MFA Rules not processed for user `29348f8d69b44ae8bb850408821863fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.017785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.018620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.057405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:37.080891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ea0b4-83e2-44e4-aaa4-2cbe2ea3fd35 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.084706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.085538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.085661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.085869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.090714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 798/1607] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.095567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.146457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.148004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48ccdd-7396-48b1-97af-7c94b87e057c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.158048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 810/1608] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:37.159289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ec0e-e101-4849-9422-96a9b7578f3d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.159427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2f83-610c-456d-b092-fb4811e5f01f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.159578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ec0e-e101-4849-9422-96a9b7578f3d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.159894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4ec0e-e101-4849-9422-96a9b7578f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.164354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.165028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.165310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.165580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] PATH_INFO: `/v3/projects/7783ac445eb8432e8e91010b40570e71/users/236a8fb93bae48dd82086f1f35d1fdba/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.182201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7783ac445eb8432e8e91010b40570e71, user_id=236a8fb93bae48dd82086f1f35d1fdba, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.184995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1864e8-05c8-4ffe-802a-1f4df17d7e84 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.189725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4c4ec0e-e101-4849-9422-96a9b7578f3d None None] MFA Rules not processed for user `3a697426bd7842209e709f85405856e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.191134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4c4ec0e-e101-4849-9422-96a9b7578f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.203687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 799/1609] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:37 2022] PUT /identity/v3/projects/7783ac445eb8432e8e91010b40570e71/users/236a8fb93bae48dd82086f1f35d1fdba/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:37.206256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.206547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.206828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.231123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.232503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.272317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 811/1610] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.273854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e858-321d-4727-aed8-8d9a1d913f2e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.274138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e858-321d-4727-aed8-8d9a1d913f2e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.274411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e858-321d-4727-aed8-8d9a1d913f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.294143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7048e858-321d-4727-aed8-8d9a1d913f2e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.295574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7048e858-321d-4727-aed8-8d9a1d913f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.331621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 800/1611] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.338027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.358679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:37.392780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 812/1612] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.392780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbf34-92a6-48fb-a764-f9a4d02b1b39 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.392780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbf34-92a6-48fb-a764-f9a4d02b1b39 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.392780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbf34-92a6-48fb-a764-f9a4d02b1b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.406628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5bb3d-52ae-4553-bfe5-7086638edd5f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.411984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.412742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.412971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.413313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.416337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:37.424885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.426373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.426718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c5dcbf34-92a6-48fb-a764-f9a4d02b1b39 None None] MFA Rules not processed for user `3f639747a95847fa925cb5e6927c59d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.428051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c5dcbf34-92a6-48fb-a764-f9a4d02b1b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.437399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 801/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:37.439303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.449503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cb9a-219a-41ee-a656-d2d4572291a7 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.455776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.458307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.458846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.458846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.460602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.462679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102df9d-6c03-4389-b722-a4db63aa00c2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.499667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 802/1614] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:37.499667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.499667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.499667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.518068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 813/1615] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.519524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d23-fd45-4384-838f-250863fa4c09 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.519944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d23-fd45-4384-838f-250863fa4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.520325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f766d23-fd45-4384-838f-250863fa4c09 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.526589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 814/1616] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 4 20:58:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:37.527548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766d23-fd45-4384-838f-250863fa4c09 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.538353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.539584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.620593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f766d23-fd45-4384-838f-250863fa4c09 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.628347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.629852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.630312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.630620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.641156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 803/1617] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:37.642004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.653692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b0c8-cf45-4b06-b185-c5ef5e4a6ce4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.658599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.659334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.659619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.659998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.671382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.673863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.685718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 804/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:37.686686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.697516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62ca57-0ce9-4c1f-a46d-d3ed5744f124 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.702601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.703235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.703570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.703902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.704612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.706673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428f38-4c43-4420-b8d3-ad02b909b194 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.729137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.731169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ca592-65c9-4f8f-8817-bbf453a982f6 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.738757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 805/1619] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/users => generated 309 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:37.744390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.745062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.745232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 815/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:37.745385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.746849 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06a76-bb19-40f5-a834-51a5efc023cc None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.747177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06a76-bb19-40f5-a834-51a5efc023cc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.747452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f06a76-bb19-40f5-a834-51a5efc023cc None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.754836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 816/1621] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 4 20:58:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:37.755704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f06a76-bb19-40f5-a834-51a5efc023cc None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.780016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f06a76-bb19-40f5-a834-51a5efc023cc None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.785845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.787292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.787292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.787292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.788501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.790172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.810432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 817/1622] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:37.812964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:37.828585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078a0f-f24f-46b2-b226-db1cf7a9df41 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:37.830684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.834565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:37.835323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.835611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.835964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.843501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.851926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:37.853725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e8236-f7e6-4529-9bf2-4b85e83c9ab4 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:37.867528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 818/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:37.869220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:37.869579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:37.870237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:37.901863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:37.903300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:37.936008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:37.967407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:38.008876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 806/1624] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:38.009755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.018815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 819/1625] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 4 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:38.019888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.034150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef368bb-5580-442d-9994-f67736ef99f2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:38.034411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f742b8-a8a2-460a-ab12-79857219a670 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:38.041953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:38.042905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.043467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.043973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.052574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:38.053494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.053782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.054095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] PATH_INFO: `/v3/projects/b41afe283b6b4594bbbccb5d216036be/users/c3c00e0aa8264a9fb9be1b18bde7f0ba/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.090776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41afe283b6b4594bbbccb5d216036be, user_id=c3c00e0aa8264a9fb9be1b18bde7f0ba, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:38.100682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:38.127858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 807/1626] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:38 2022] PUT /identity/v3/projects/b41afe283b6b4594bbbccb5d216036be/users/c3c00e0aa8264a9fb9be1b18bde7f0ba/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:38.128849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.146333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:38.149228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:38.179059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 820/1627] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:38.181455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.212568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9529f5-27d1-4fbb-bf32-b9010a03004e service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:38.238630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0201b-4f36-4c09-b629-5d14cefa11d0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:38.247447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:38.248264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.248544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.248862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.384624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:38.385627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:38.386243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:38.386740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.387245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.387739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.394585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:38.396520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bf28e-5c67-4344-bc45-aeb4f9fb5d72 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:38.408088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 808/1628] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:38.418466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 821/1629] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:38.423923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.444707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a38ac-25d6-4b60-bc17-99f61ad0d7bc service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:38.454907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:38.454907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.454907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.454907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] PATH_INFO: `/v3/projects/b41afe283b6b4594bbbccb5d216036be/users/c3c00e0aa8264a9fb9be1b18bde7f0ba/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.457243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41afe283b6b4594bbbccb5d216036be, user_id=c3c00e0aa8264a9fb9be1b18bde7f0ba, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:38.461568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd577be-6b40-4405-9590-9ec56f8347fe admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:38.488387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 809/1630] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:38 2022] PUT /identity/v3/projects/b41afe283b6b4594bbbccb5d216036be/users/c3c00e0aa8264a9fb9be1b18bde7f0ba/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:38.705574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eff7-42d4-402a-9a7e-4a5ee9fb6d87 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.705909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eff7-42d4-402a-9a7e-4a5ee9fb6d87 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.706144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253eff7-42d4-402a-9a7e-4a5ee9fb6d87 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.707671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 822/1631] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 4 20:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:38.714047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d907dc-a74d-40f2-bd7c-107dc71f8c81 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.714611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d907dc-a74d-40f2-bd7c-107dc71f8c81 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.714611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d907dc-a74d-40f2-bd7c-107dc71f8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.738855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-62d907dc-a74d-40f2-bd7c-107dc71f8c81 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:38.740272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-62d907dc-a74d-40f2-bd7c-107dc71f8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:38.811651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:38.867775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 810/1632] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:38.881015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eff7-42d4-402a-9a7e-4a5ee9fb6d87 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:38.994685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dac0fc-3651-4b4e-a3ef-214f24790c18 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:38.995397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dac0fc-3651-4b4e-a3ef-214f24790c18 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:38.996052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dac0fc-3651-4b4e-a3ef-214f24790c18 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:38.998850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 811/1633] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 4 20:58:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:39.009271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:39.009951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:39.010428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:39.071297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:39.074354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:39.077425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253eff7-42d4-402a-9a7e-4a5ee9fb6d87 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:39.086242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:39.087330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:39.087862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:39.088374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:39.112008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:39.119484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 812/1634] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:58:39.120852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:39.124051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:39.134055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:39.148639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 823/1635] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:39.169678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfeda-7873-4b1d-8d59-5db56c4e83c5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:39.176376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:39.177767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:39.178250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:39.178712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:39.218610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:39.222691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4efdd8-69a9-4ec0-befb-b5c07459acae service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:39.244267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 813/1636] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:58:39.579696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:39.752998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0a03-a6a6-47fe-85f5-913aae020a8d service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:39.776899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:39.780310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:39.782363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:39.782821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] PATH_INFO: `/v3/users/3f639747a95847fa925cb5e6927c59d7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:39.786284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f639747a95847fa925cb5e6927c59d7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:39.795570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:39.943816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f639747a95847fa925cb5e6927c59d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:39.944985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f639747a95847fa925cb5e6927c59d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:39.959104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f639747a95847fa925cb5e6927c59d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:39.983207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f639747a95847fa925cb5e6927c59d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:40.011638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f639747a95847fa925cb5e6927c59d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:40.031985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 824/1637] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:58:39 2022] DELETE /identity/v3/users/3f639747a95847fa925cb5e6927c59d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:40.033561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95f24-27e0-47f4-b8be-10bc442ed882 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:40.034077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95f24-27e0-47f4-b8be-10bc442ed882 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:40.034219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95f24-27e0-47f4-b8be-10bc442ed882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:40.072033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-93d95f24-27e0-47f4-b8be-10bc442ed882 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:40.073480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-93d95f24-27e0-47f4-b8be-10bc442ed882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:40.267460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 814/1638] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:40.313328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:40.316281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:40.520565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ec05-9403-4e66-9b3c-5bf036d38876 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:40.548310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:40.550897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:40.551293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:40.552182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:40.612898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:40.624117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:40.668335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 825/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:41.331707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8cae-dc5e-48db-ac24-858f6b5389ce None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:41.332196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8cae-dc5e-48db-ac24-858f6b5389ce None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:41.332196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8cae-dc5e-48db-ac24-858f6b5389ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:41.381623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-272a8cae-dc5e-48db-ac24-858f6b5389ce None None] MFA Rules not processed for user `c3c00e0aa8264a9fb9be1b18bde7f0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:41.383707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-272a8cae-dc5e-48db-ac24-858f6b5389ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:41.526154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 815/1640] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:41.994202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:41.997305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:42.016941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07331a58-e588-46d8-a696-e5a1d3d7c247 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.053605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.054293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.054627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.054905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] PATH_INFO: `/v3/projects/ba77ecab7f8d4d2292550b9e2fc4ee38` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.056334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba77ecab7f8d4d2292550b9e2fc4ee38)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.057363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: WARNING py.warnings [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:42.057363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: warnings.warn(msg) Aug 04 20:58:42.057363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: Aug 04 20:58:42.058560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.089156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:42.183922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba77ecab7f8d4d2292550b9e2fc4ee38', 'request_id': 'req-0d13350d-3d00-42f9-97a2-04b7113c0e71'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:42.206537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba77ecab7f8d4d2292550b9e2fc4ee38', 'request_id': 'req-0d13350d-3d00-42f9-97a2-04b7113c0e71'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:42.221001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba77ecab7f8d4d2292550b9e2fc4ee38', 'request_id': 'req-0d13350d-3d00-42f9-97a2-04b7113c0e71'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:42.290226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] The token cache is being invalidate because project ba77ecab7f8d4d2292550b9e2fc4ee38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:58:42.290226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:42.290226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0d13350d-3d00-42f9-97a2-04b7113c0e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:42.290226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 826/1641] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:58:41 2022] DELETE /identity/v3/projects/ba77ecab7f8d4d2292550b9e2fc4ee38 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:42.306807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.307028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.307200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.357365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:42.358695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:42.469615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:42.502166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 816/1642] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:42.504057 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.504301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.504587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.551192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:42.552378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:42.575062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 827/1643] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:42.576333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:42.589321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936d85e-7e73-4c83-b8da-ea80a37cc1d8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.597527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.598339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.598751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.599322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.601386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:42.601857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.604978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.623811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 817/1644] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:42.628276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:42.639303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95104d-4db7-43d4-af05-61a6035b1309 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.646125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.646883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.647315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.647734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.648869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.651308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.700631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 828/1645] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:42 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:42.705554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:42.723617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a09e08-8288-4993-96e0-f50cd5e679c6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.825130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.826600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.826996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.827381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.829408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.831653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.881554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 818/1646] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:42 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:42.888419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:42.909886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213518b5-90fe-4360-b8c4-10cbfa00535b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.920655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.921723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.922826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.924261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.926519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.931522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.947185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 829/1647] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:42.951381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:42.963494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c5ec-f1ce-43bb-9833-39bdf63f4dad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:42.969870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:42.970647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:42.970937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:42.971219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:42.972338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:42.974153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303846-b91e-4fcd-a0ab-2bc722eddf98 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:42.991925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 819/1648] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:42.993002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:43.005286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31d71c-43d2-4c2f-85c9-f442a13f7c34 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:43.029089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:43.030113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.030538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.031719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] PATH_INFO: `/v3/projects/a5b4aff8398a475d8a1d0c8003ec6c6e/users/5a9a334886c145658cd8d63b74ee368d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.099250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b4aff8398a475d8a1d0c8003ec6c6e, user_id=5a9a334886c145658cd8d63b74ee368d, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:43.106302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:43.153511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 830/1649] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:42 2022] PUT /identity/v3/projects/a5b4aff8398a475d8a1d0c8003ec6c6e/users/5a9a334886c145658cd8d63b74ee368d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:43.166981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.166981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.166981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.244789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] MFA Rules not processed for user `5a9a334886c145658cd8d63b74ee368d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:43.246043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:43.267538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:43.270115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:43.467360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 820/1650] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:43.475256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:43.492252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158277ac-c637-465e-a648-6fd05e92f6cd None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:43.502604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:43.504440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.504736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.505009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.505706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:43.507061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ab97-c81e-4cae-ab97-1f58cdd1d11d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:43.514930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:43.520637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:43.521388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.521680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.521961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] PATH_INFO: `/v3/users/3a697426bd7842209e709f85405856e8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.523916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a697426bd7842209e709f85405856e8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:43.534335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:43.589299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 821/1651] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:43 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:43.595142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:43.635994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:43.673635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:43.688381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a697426bd7842209e709f85405856e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:43.689069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a697426bd7842209e709f85405856e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:43.699766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a697426bd7842209e709f85405856e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:43.710851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a697426bd7842209e709f85405856e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:43.728858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-70f9dd3f-ed18-454d-9a1e-5281852cd2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a697426bd7842209e709f85405856e8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:43.771497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 831/1652] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:58:43 2022] DELETE /identity/v3/users/3a697426bd7842209e709f85405856e8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:43.771737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52a57-0211-4ace-a34b-bfa94d753ac2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:43.779839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633419-fb68-49a3-bc8f-6a0f09c11a2d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.781670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633419-fb68-49a3-bc8f-6a0f09c11a2d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.782820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29633419-fb68-49a3-bc8f-6a0f09c11a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.866308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29633419-fb68-49a3-bc8f-6a0f09c11a2d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:43.877281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29633419-fb68-49a3-bc8f-6a0f09c11a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:43.980873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:43.982563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:43.982769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:43.983052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:43.984296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:43.989538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.034678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 832/1653] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:44.036403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 822/1654] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:43 2022] POST /identity/v3/users => generated 293 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:44.036523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce978b-b2eb-44cc-86d7-1fc27b4badef None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.037015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce978b-b2eb-44cc-86d7-1fc27b4badef None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.037294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce978b-b2eb-44cc-86d7-1fc27b4badef None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.039075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 833/1655] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:44.047252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:44.055928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:44.071874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d6f4e-e766-4c92-ac53-97deb7f5bb59 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:44.081889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:44.084216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.085391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.086097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.088035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:44.090642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5630-223d-4ddb-92d2-5c5642fa44ee admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.106238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 823/1656] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:44.109452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce978b-b2eb-44cc-86d7-1fc27b4badef None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:44.129558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce978b-b2eb-44cc-86d7-1fc27b4badef None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:44.135694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:44.137696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.138202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.138732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] PATH_INFO: `/v3/projects/4edd7e418038493dbcab400dcfc1d0d3/users/5717d38d0cce453a817fb9d0a4944573/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.182839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.183239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.183963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.200720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edd7e418038493dbcab400dcfc1d0d3, user_id=5717d38d0cce453a817fb9d0a4944573, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:44.206278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.239567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:44.241428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:44.253625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 834/1657] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:44 2022] PUT /identity/v3/projects/4edd7e418038493dbcab400dcfc1d0d3/users/5717d38d0cce453a817fb9d0a4944573/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:58:44.258251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:44.263005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:44.424797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 824/1658] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:58:44.425687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:44.473017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db70f-c557-4418-9edb-b014b6591b57 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:44.491588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:44.495293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.495582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.495925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.541287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:44.598998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4c107-3a79-494b-a1df-e3481b7c9633 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:44.609052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:44.612016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.614099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.614571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.615886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:44.622396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf903-5006-4831-aea5-e55d3fa3ec9d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.645763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:44.659488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 825/1659] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:44.661298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9cf3-77df-4840-8099-7b0a7b9661d2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.665781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9cf3-77df-4840-8099-7b0a7b9661d2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.666274 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9cf3-77df-4840-8099-7b0a7b9661d2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.669194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 826/1660] 10.222.0.45 () {54 vars in 961 bytes} [Thu Aug 4 20:58:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:44.670171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b9cf3-77df-4840-8099-7b0a7b9661d2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:44.704761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:44.706613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b9cf3-77df-4840-8099-7b0a7b9661d2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:44.710369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf6943-e00a-49ca-833c-3cf0a723e743 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.716680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:44.717385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.717716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.718055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] PATH_INFO: `/v3/projects/4edd7e418038493dbcab400dcfc1d0d3/users/5717d38d0cce453a817fb9d0a4944573/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.722711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edd7e418038493dbcab400dcfc1d0d3, user_id=5717d38d0cce453a817fb9d0a4944573, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:44.728833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3329621-dfbb-42cd-a874-43af96103513 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:44.751861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 835/1661] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:44.755447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.755782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.757890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.762174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 827/1662] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:44 2022] PUT /identity/v3/projects/4edd7e418038493dbcab400dcfc1d0d3/users/5717d38d0cce453a817fb9d0a4944573/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:44.774167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:44.774466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:44.774732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:44.822436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] MFA Rules not processed for user `5717d38d0cce453a817fb9d0a4944573`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:44.823911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:44.830013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:44.833478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:45.006723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 828/1663] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:45.017029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:45.018644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:45.071076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 836/1664] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Aug 4 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:45.085748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:45.124535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa1ca5-bc31-4682-92a4-681ae4158d57 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:45.140215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:45.140914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:45.141239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:45.141516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:45.164078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:45.165727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:45.195888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 837/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:58:45.279478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cb51f-f320-4d8c-b84f-46bc9473a2c2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:45.288212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:45.289020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:45.289408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:45.289788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:45.318197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:45.321370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:45.338449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 829/1666] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:45.527761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:45.544493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d655-378a-4d15-a239-627fc1d25d2e service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:45.554363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:45.555281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:45.555714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:45.556184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:45.562795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:45.778820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:45.785247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ba50-bded-44d9-835a-45f863444df5 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:45.818436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 838/1667] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:46.415098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:46.416834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:46.578201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:46.612108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37cd11-1267-45e9-a28f-9964ac4c1be1 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:46.617374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:46.618357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:46.618651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:46.618932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] PATH_INFO: `/v3/projects/896982ce8af14f5da006e44b34bd2063` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:46.621340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896982ce8af14f5da006e44b34bd2063)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:46.632065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:46.751226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896982ce8af14f5da006e44b34bd2063', 'request_id': 'req-de1cc573-8369-4157-893b-9b66f670f016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:46.779375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896982ce8af14f5da006e44b34bd2063', 'request_id': 'req-de1cc573-8369-4157-893b-9b66f670f016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:46.786433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896982ce8af14f5da006e44b34bd2063', 'request_id': 'req-de1cc573-8369-4157-893b-9b66f670f016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:46.805021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] The token cache is being invalidate because project 896982ce8af14f5da006e44b34bd2063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:58:46.805615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:46.806480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de1cc573-8369-4157-893b-9b66f670f016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:46.808673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 830/1668] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:58:46 2022] DELETE /identity/v3/projects/896982ce8af14f5da006e44b34bd2063 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:46.814414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:46.814958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:46.814958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:46.850684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:46.856504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:46.972243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 839/1669] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:46.979587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:46.980019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:46.980837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.004141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:47.005540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:47.015435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 831/1670] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:47.019820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.034985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:47.044596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31199b4e-c065-4eff-950e-f92205309e07 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.055082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.056087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.057137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.057755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.060100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:47.061790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.064463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.081959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 840/1671] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:58:47.082869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.096541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b87d1-df3c-4de1-aec0-57389ba68545 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.108616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.109276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.109561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.110415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.111124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.117847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.184887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 832/1672] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:47 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:58:47.187157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.210488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61b09-75ef-4969-a574-4d0d68537f34 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.437413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.438759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.439097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.439257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.440125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.442246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.498072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 841/1673] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:47 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:47.498620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.519056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b363985-9c00-43cf-aee4-26644f464b4b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.545098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.546292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.546584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.546866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.550101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.552067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.580281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 833/1674] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:47.584420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.612587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04346e-c2b4-46dd-bd4a-bbd044eeeb10 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.634510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.635159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.635442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.635724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.643478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.648908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885c460-4e1a-49fd-b109-7d25b7ca6e5a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.698824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:47.699810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 842/1675] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:47.719940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8e7cd-ae62-4226-9119-cdd49fefebad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:47.731572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:47.732303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.732587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.732864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] PATH_INFO: `/v3/projects/01fdf5043e0e4c85b0340e6a16bbe3ba/users/2c383cfa10cb45dd96bf2edc1664affd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.776609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fdf5043e0e4c85b0340e6a16bbe3ba, user_id=2c383cfa10cb45dd96bf2edc1664affd, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:47.786993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:47.818175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 834/1676] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:47 2022] PUT /identity/v3/projects/01fdf5043e0e4c85b0340e6a16bbe3ba/users/2c383cfa10cb45dd96bf2edc1664affd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:47.830564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda641dc-1dc7-419b-8b47-dbd230467b04 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:47.831564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda641dc-1dc7-419b-8b47-dbd230467b04 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:47.831918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda641dc-1dc7-419b-8b47-dbd230467b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:47.893395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dda641dc-1dc7-419b-8b47-dbd230467b04 None None] MFA Rules not processed for user `2c383cfa10cb45dd96bf2edc1664affd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:47.894910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dda641dc-1dc7-419b-8b47-dbd230467b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:48.060640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 843/1677] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:48.072845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:48.074510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:48.207525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb841f6-9788-4db1-821b-39bf3b120e2d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:48.219725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:48.220404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:48.220692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:48.220972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:48.235946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:48.239547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac876c3-6897-4781-a35e-482cff810122 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:48.262575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 835/1678] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:58:48.818254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:48.818254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:48.818254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:48.818254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 844/1679] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:58:48.930531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246102-c798-40cc-8ebd-a13a2ad92619 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:48.930997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246102-c798-40cc-8ebd-a13a2ad92619 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:48.931086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5246102-c798-40cc-8ebd-a13a2ad92619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:48.995658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a5246102-c798-40cc-8ebd-a13a2ad92619 None None] MFA Rules not processed for user `a01a4b3ff4334746912df78fae4e2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:48.997490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a5246102-c798-40cc-8ebd-a13a2ad92619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:49.019992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:49.185072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 836/1680] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:49.241665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:49.244209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:49.305575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88342923-689b-4175-81e0-bd7974c0a0a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:49.313582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:49.315124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:49.315563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:49.316029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:49.327642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:49.331582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:49.332095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:49.332932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:49.343869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:49.398333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 845/1681] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:49.436110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] MFA Rules not processed for user `b23a317904864972b875257cfcd90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:49.447091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:49.515901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:49.517605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:49.627899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:49.649277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 837/1682] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:49.666475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:49.668153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:49.669490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097d87-be28-4946-be15-66e915c8e905 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:49.686134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:49.687089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:49.687561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:49.688231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] PATH_INFO: `/v3/users/29348f8d69b44ae8bb850408821863fd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:49.691712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29348f8d69b44ae8bb850408821863fd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:49.693927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:49.854141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29348f8d69b44ae8bb850408821863fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:49.855726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29348f8d69b44ae8bb850408821863fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:49.876819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29348f8d69b44ae8bb850408821863fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:49.949638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29348f8d69b44ae8bb850408821863fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:49.987491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9415a1-a382-428b-94f1-2e0fc3747f43 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:50.015625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29348f8d69b44ae8bb850408821863fd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:50.029049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:50.029991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:50.030099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:50.030308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:50.042835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:50.051374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 846/1683] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:58:49 2022] DELETE /identity/v3/users/29348f8d69b44ae8bb850408821863fd => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:58:50.075425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:50.080157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:50.147205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 838/1684] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:58:51.310639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:51.312236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:51.489025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be2e4-66ad-46aa-89e4-3baa7de011f8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:51.494236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:51.495180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:51.495719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:51.496248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] PATH_INFO: `/v3/projects/35774fc25d4a4023bf913644842858e7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:51.498069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=35774fc25d4a4023bf913644842858e7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:51.501414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:51.574534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35774fc25d4a4023bf913644842858e7', 'request_id': 'req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.584383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35774fc25d4a4023bf913644842858e7', 'request_id': 'req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.595038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35774fc25d4a4023bf913644842858e7', 'request_id': 'req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.598497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:51.626900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] The token cache is being invalidate because project 35774fc25d4a4023bf913644842858e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:58:51.627210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.630099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.636812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 847/1685] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:58:51 2022] DELETE /identity/v3/projects/35774fc25d4a4023bf913644842858e7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:51.637855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:51.658261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbbbdd-c49b-4bb6-951e-763fb11c8113 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:51.765314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:51.818374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:51.820328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:51.821165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:51.821885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] PATH_INFO: `/v3/users/c3c00e0aa8264a9fb9be1b18bde7f0ba` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:51.823543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c00e0aa8264a9fb9be1b18bde7f0ba)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:51.824948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: WARNING py.warnings [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 20:58:51.824948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: warnings.warn(msg) Aug 04 20:58:51.824948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: Aug 04 20:58:51.827192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:51.981276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c00e0aa8264a9fb9be1b18bde7f0ba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:51.982658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c00e0aa8264a9fb9be1b18bde7f0ba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:52.016641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c00e0aa8264a9fb9be1b18bde7f0ba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:52.034275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c00e0aa8264a9fb9be1b18bde7f0ba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:52.035328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d7082654-a3fa-45a7-874e-65ff5d71d42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c00e0aa8264a9fb9be1b18bde7f0ba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:52.097840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 839/1686] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:58:51 2022] DELETE /identity/v3/users/c3c00e0aa8264a9fb9be1b18bde7f0ba => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:53.039495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:53.041579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:53.066617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb81e-da4b-41a1-a21d-bee580eb0eaa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:53.213722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:53.214686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:53.216141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:53.216612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] PATH_INFO: `/v3/projects/b41afe283b6b4594bbbccb5d216036be` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:53.220624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41afe283b6b4594bbbccb5d216036be)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:53.225509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:53.362468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41afe283b6b4594bbbccb5d216036be', 'request_id': 'req-137b68a2-ddac-4f45-8b40-1e8be47a5d15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:53.383505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41afe283b6b4594bbbccb5d216036be', 'request_id': 'req-137b68a2-ddac-4f45-8b40-1e8be47a5d15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:53.413692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41afe283b6b4594bbbccb5d216036be', 'request_id': 'req-137b68a2-ddac-4f45-8b40-1e8be47a5d15'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:53.438815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] The token cache is being invalidate because project b41afe283b6b4594bbbccb5d216036be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:58:53.439405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:53.440801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-137b68a2-ddac-4f45-8b40-1e8be47a5d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:58:53.444025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 848/1687] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:58:53 2022] DELETE /identity/v3/projects/b41afe283b6b4594bbbccb5d216036be => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:53.449260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:53.449788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:53.449788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:53.524469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:53.529190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:53.681766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 840/1688] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:53.690102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:53.691166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:53.691865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:53.733778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:53.741500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:53.758785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 849/1689] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:53.763012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:53.775917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985e7f4-071d-4cef-8dae-8e9c5aeffb1d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:53.783040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:53.783865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:53.784201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:53.784560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:53.785508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:58:53.786768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:53.789138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:53.817599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 841/1690] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:58:53.818566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:53.836897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512cce-6d8b-4ba5-8e98-09c95bbfcca4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:53.868756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:53.870347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:53.871926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:53.872238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:53.873260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:53.880334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:53.983735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 850/1691] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:53 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:58:53.984037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:54.002460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ef903-e7a4-4b4a-9897-e3666c3be91a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:54.119595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:54.192474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:54.193491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:54.193491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:54.193745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:54.194508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:54.196595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:54.250245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 842/1692] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:53 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:54.254858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:54.271993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3e25d-7fa8-48f4-8f34-6098bf6ce84b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:54.287094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:54.290326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:54.290826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:54.291219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:54.292973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:54.296741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:54.328751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:54.330396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 851/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:54.351104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f1fe-1edb-4190-88c3-474835b862f6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:54.392835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:54.393583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:54.393972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:54.394511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:54.395366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:54.397272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5073-e8fd-421d-b458-73706bbbb556 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:54.434195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 843/1694] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:54.439003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:54.470833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f8af-713d-487e-bc9d-673f965b093f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:54.497098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:54.497781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:54.498427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:54.498717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] PATH_INFO: `/v3/projects/80a54a8c2fc7477c827a52ad34206de6/users/6c55acf4c3b74f2f9417f8457a51832c/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:54.564986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a54a8c2fc7477c827a52ad34206de6, user_id=6c55acf4c3b74f2f9417f8457a51832c, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:54.570164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:54.607327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 852/1695] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:54 2022] PUT /identity/v3/projects/80a54a8c2fc7477c827a52ad34206de6/users/6c55acf4c3b74f2f9417f8457a51832c/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:54.620163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:54.620715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:54.620715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:54.722093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] MFA Rules not processed for user `6c55acf4c3b74f2f9417f8457a51832c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:54.723665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:54.959781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 844/1696] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:54.964307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:55.045316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:55.196589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda1d1-8534-4764-85a9-9777377eec17 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:55.219343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:55.220084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:55.220392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:55.220701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:55.221547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:55.230684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:55.346233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 853/1697] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:58:54 2022] POST /identity/v3/projects => generated 391 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:55.350337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:55.431106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531a08-b032-4feb-8782-cc58b6a6c745 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:55.583216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:55.584169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:55.584530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:55.584845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:55.585770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:55.588804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:55.679695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 845/1698] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:58:55 2022] POST /identity/v3/users => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:58:55.686794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:55.721902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fd427-9291-4180-a398-32a9cbd3d743 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:55.749656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:55.759323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:55.759644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:55.759965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:55.760926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:55.762602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:55.783023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 854/1699] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:58:55.786362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:55.802329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30349f88-8122-48a7-83f2-019999a0b111 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:55.822487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:55.823187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:55.823471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:55.823766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] PATH_INFO: `/v3/projects/aa4c1b68604441f1aa7b97241965e8fd/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:55.868904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c1b68604441f1aa7b97241965e8fd, user_id=eab73a8c0fbb43a58a2fb2ff1b4cc8a1, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:55.872221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:55.917682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 846/1700] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:55 2022] PUT /identity/v3/projects/aa4c1b68604441f1aa7b97241965e8fd/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:55.921574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:55.949105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e6d5f-2b0a-4d49-ade6-aa6a4c2296f0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:56.103118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:56.103776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:56.104070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:56.104350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:56.105067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:56.106712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42292e47-21c9-4e4a-b1e9-50ff8cf24861 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:56.129097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 855/1701] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:58:56.133761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:56.152401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304995c-dd22-4a9e-a289-b2a246c08218 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:56.181487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:56.183469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:56.183785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:56.184765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] PATH_INFO: `/v3/projects/aa4c1b68604441f1aa7b97241965e8fd/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:56.206765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c1b68604441f1aa7b97241965e8fd, user_id=eab73a8c0fbb43a58a2fb2ff1b4cc8a1, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:56.211305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:56.230964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:56.251896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 847/1702] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:58:56 2022] PUT /identity/v3/projects/aa4c1b68604441f1aa7b97241965e8fd/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:58:56.263876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:56.264732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:56.265224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:56.363092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] MFA Rules not processed for user `eab73a8c0fbb43a58a2fb2ff1b4cc8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:56.366438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:56.658445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 856/1703] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:56.695310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:56.697467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:56.883661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ccdf2-57df-4ee6-8eea-3338f5fca259 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:56.888923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:56.889918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:56.891367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:56.892664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:56.908493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:56.916507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef08c7-e9b8-4859-a285-ba87c3ed9378 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:56.939665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 848/1704] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:57.059048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:57.060746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:57.091657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa72ed-8767-4b34-9b25-3bdaf048ed6e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:57.096054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:57.097711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:57.100226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:57.105265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:57.154279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:57.327667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:57.330759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:57.369910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 857/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:58.453503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533028ce-617a-40bd-98fd-8583c8363e85 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:58.454968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533028ce-617a-40bd-98fd-8583c8363e85 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:58.456335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533028ce-617a-40bd-98fd-8583c8363e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:58.504683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-533028ce-617a-40bd-98fd-8583c8363e85 None None] MFA Rules not processed for user `eb570550f73e4d6a8c87d2bc0c12b4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:58.506059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-533028ce-617a-40bd-98fd-8583c8363e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:58.764775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 849/1706] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:58.790092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:58.791590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:58.833173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f708f-5efd-48dd-b7bc-8efb1754ecb3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:58.833461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f708f-5efd-48dd-b7bc-8efb1754ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:58.833765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f708f-5efd-48dd-b7bc-8efb1754ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:58.919915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ea1f708f-5efd-48dd-b7bc-8efb1754ecb3 None None] MFA Rules not processed for user `ab4b1b421a35490fa717ad21dc46eb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:58.924652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ea1f708f-5efd-48dd-b7bc-8efb1754ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.007395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9ddc0-ea2b-4ca9-9180-e95beb9ad3b2 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:59.027346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:59.028039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.028324 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.035976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.073935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:59.075575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387403d0-0ffe-4336-af12-33f9739690be service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:59.110315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 858/1707] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:58:59.146405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53238-2cb6-4196-80cb-c4903de57441 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.146699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53238-2cb6-4196-80cb-c4903de57441 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.146985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53238-2cb6-4196-80cb-c4903de57441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.189018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 850/1708] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:58:59.195993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e349d-dc32-4c9b-92b2-2dbfaaa12959 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.196290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e349d-dc32-4c9b-92b2-2dbfaaa12959 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.196805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e349d-dc32-4c9b-92b2-2dbfaaa12959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.261134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-55b53238-2cb6-4196-80cb-c4903de57441 None None] MFA Rules not processed for user `71add7accd2045d8868ee78a671327fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:59.267390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55b53238-2cb6-4196-80cb-c4903de57441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.274633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7c7e349d-dc32-4c9b-92b2-2dbfaaa12959 None None] MFA Rules not processed for user `ab4b1b421a35490fa717ad21dc46eb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:59.276106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7c7e349d-dc32-4c9b-92b2-2dbfaaa12959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.285851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 851/1709] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:59.300160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.300539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.300737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.344204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] MFA Rules not processed for user `b23a317904864972b875257cfcd90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:59.349625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.373683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:58:59.591319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 852/1710] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:59.593060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:58:59.600567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.606168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 859/1711] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:58:59.612591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.613127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.614578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.677375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5d7a-9f42-470b-9298-db4c39835e6d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:58:59.696017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:58:59.696265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] MFA Rules not processed for user `71add7accd2045d8868ee78a671327fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:58:59.699514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:58:59.699514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:58:59.699807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:58:59.701740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:58:59.735564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 860/1712] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:58:59.742291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:58:59.744228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff15ffc-984e-4b64-8239-39a09e11e2ec service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:58:59.777622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 853/1713] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:00.626539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:00.629449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:00.702385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:00.778010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e308-5082-4f6f-b512-1c134ebbd93a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:00.785645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:00.787059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:00.787059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:00.787474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] PATH_INFO: `/v3/users/2c383cfa10cb45dd96bf2edc1664affd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:00.788897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c383cfa10cb45dd96bf2edc1664affd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:00.791466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:00.869589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c383cfa10cb45dd96bf2edc1664affd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:00.870596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c383cfa10cb45dd96bf2edc1664affd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:00.896981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c383cfa10cb45dd96bf2edc1664affd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:00.926495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c383cfa10cb45dd96bf2edc1664affd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:00.947096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c383cfa10cb45dd96bf2edc1664affd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:00.958493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 861/1714] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:00 2022] DELETE /identity/v3/users/2c383cfa10cb45dd96bf2edc1664affd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:00.962986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127426-f1a5-49d2-9656-88189deaa794 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:00.963464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127426-f1a5-49d2-9656-88189deaa794 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:00.963575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127426-f1a5-49d2-9656-88189deaa794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:00.986701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c1127426-f1a5-49d2-9656-88189deaa794 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:00.989177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c1127426-f1a5-49d2-9656-88189deaa794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.096435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 854/1715] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:01.169546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:01.170738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.365805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09a25-a363-4695-8c64-d4adda0bdbb5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:01.379478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:01.379478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.379892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.380938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.406888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:01.409461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32bc3b-de78-41ee-b166-fe7a66b1dd02 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:01.433703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 862/1716] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:01.508497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6ee2-e3f0-426c-88a2-0bcdc3f3def2 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.508869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6ee2-e3f0-426c-88a2-0bcdc3f3def2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.509254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6ee2-e3f0-426c-88a2-0bcdc3f3def2 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.510874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 855/1717] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 4 20:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:59:01.535349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a052-0974-485d-a916-c872629dede3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.536634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a052-0974-485d-a916-c872629dede3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.537136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410a052-0974-485d-a916-c872629dede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.621874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915c665-3b0b-466c-a8b2-29804f8b897c None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.622546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915c665-3b0b-466c-a8b2-29804f8b897c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.623025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915c665-3b0b-466c-a8b2-29804f8b897c None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.625934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 856/1718] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 4 20:59:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:59:01.632599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.633167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.633650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.646837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6410a052-0974-485d-a916-c872629dede3 None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:01.648905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6410a052-0974-485d-a916-c872629dede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.678873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 863/1719] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:01.686305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:01.689197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.718227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 857/1720] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:01.787011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a052-0974-485d-a916-c872629dede3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:01.789022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6410a052-0974-485d-a916-c872629dede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.792498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:01.794185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:01.821806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410a052-0974-485d-a916-c872629dede3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:01.822416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fd8ab-a72c-4400-9949-2303eebc7f24 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:01.834246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:01.835895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:01.836637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.837369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:01.837767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.838141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:01.838591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.842798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:01.862594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:01.863647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:01.865291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3da489-4f85-439d-bd5b-c5eff86812b5 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:01.865937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:01.884631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 858/1721] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:01.888922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 864/1722] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:02.165670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:02.166128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:02.166473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:02.287874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] MFA Rules not processed for user `236a8fb93bae48dd82086f1f35d1fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:02.289256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:02.525823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 859/1723] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:02.740513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:02.742053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:02.789586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7479534-eef1-4c05-8755-fdeb55bb88a0 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:02.810386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:02.811042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:02.811325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:02.811600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] PATH_INFO: `/v3/projects/01fdf5043e0e4c85b0340e6a16bbe3ba` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:02.815619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fdf5043e0e4c85b0340e6a16bbe3ba)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:02.821484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:02.868800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:02.936699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:02.940016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:02.962897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0a50-1365-4dbb-9903-67716dcf1e12 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:02.980889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fdf5043e0e4c85b0340e6a16bbe3ba', 'request_id': 'req-c6a99efc-d957-4938-ab7c-802b83484fb7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:02.994803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fdf5043e0e4c85b0340e6a16bbe3ba', 'request_id': 'req-c6a99efc-d957-4938-ab7c-802b83484fb7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.012174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fdf5043e0e4c85b0340e6a16bbe3ba', 'request_id': 'req-c6a99efc-d957-4938-ab7c-802b83484fb7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.024798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:03.045940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] The token cache is being invalidate because project 01fdf5043e0e4c85b0340e6a16bbe3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:03.046239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.047651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.050781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 865/1724] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:02 2022] DELETE /identity/v3/projects/01fdf5043e0e4c85b0340e6a16bbe3ba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:03.058520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:03.061941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.170169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:03.173830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.174361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.175661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] PATH_INFO: `/v3/users/6c55acf4c3b74f2f9417f8457a51832c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.177882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c55acf4c3b74f2f9417f8457a51832c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:03.183658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:03.233622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a99efc-d957-4938-ab7c-802b83484fb7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:03.248881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:03.253984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.253984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.253984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.264786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.315937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c55acf4c3b74f2f9417f8457a51832c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.317353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c55acf4c3b74f2f9417f8457a51832c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.343019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c55acf4c3b74f2f9417f8457a51832c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.357800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c55acf4c3b74f2f9417f8457a51832c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.358867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9fadc091-dacb-43db-b863-f888dd753a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c55acf4c3b74f2f9417f8457a51832c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:03.399393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 860/1725] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:02 2022] DELETE /identity/v3/users/6c55acf4c3b74f2f9417f8457a51832c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:03.400980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.401506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.402010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.433250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:03.434762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.436822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:03.439666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:03.463940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 866/1726] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:03.476494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:03.481891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.559654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 861/1727] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:03.561019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:03.567105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.612225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:03.647491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:03.726105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ab0cc-e781-4e2a-8e79-87ad6d82db15 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:03.742347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a152e2-df4c-43d9-9f4e-a59df55b1893 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:03.751460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:03.752869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.752869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.753065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.754878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.852388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:03.854036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f147638-410f-4b5c-8699-7916360ea27b service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:03.857640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:03.867313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.870628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.871223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.876249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.879414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 862/1728] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:03.901182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:03.901413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003923-2c42-47fd-8fc7-cf57d5f4f3ac None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:03.901649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003923-2c42-47fd-8fc7-cf57d5f4f3ac None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:03.902562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d003923-2c42-47fd-8fc7-cf57d5f4f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:03.907898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:03.933974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 867/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:03.937423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:03.954107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.985896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0d003923-2c42-47fd-8fc7-cf57d5f4f3ac None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:03.986360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300b16c-76dc-4a89-9c4d-e130e47b5665 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:03.987152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0d003923-2c42-47fd-8fc7-cf57d5f4f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:03.999237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:03.999936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.000226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.000517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.020711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 863/1730] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:04.022794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.030487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084bff0-183c-42fc-8bac-e3b43053bac8 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.031548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.031869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.032149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.069103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 868/1731] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:04.074411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.075473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.076306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.118058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:04.121876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:04.146861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 864/1732] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:04.146861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.150101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:04.151836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] MFA Rules not processed for user `eb570550f73e4d6a8c87d2bc0c12b4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:04.153503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:04.295896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc649d94-147d-4f6e-888b-a11c93c95f56 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:04.305244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:04.306586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.306880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.307161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.336255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.341240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.351914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 869/1733] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:04.351914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.373636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 865/1734] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:04.376754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774384c-e84a-4e1c-9329-ad0c3e59d571 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:04.404723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:04.405281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.405571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.405874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.406606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:04.406916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.415794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.445245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 870/1735] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:04.450173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.465466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd892ed7-66bc-496d-b3b1-e87d3f75d74f service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:04.477618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:04.478309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.478628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.478948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.479685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.481976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73712b-2176-4330-8174-34a42a2fcbab admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.555799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 866/1736] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:04 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:04.557288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.572284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fd751-c413-4cb2-a7b7-8b419cd75b38 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:04.713006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:04.750349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.750643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.750923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.784990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:04.785791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.787959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.789475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.791429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.795697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.816061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] MFA Rules not processed for user `ab4b1b421a35490fa717ad21dc46eb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:04.821917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:04.853974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 871/1737] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:04 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:04.862151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.891508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3284-0d9e-45ee-a7d8-5d323d10081d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:04.902180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:04.902866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:04.904585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:04.904875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:04.905613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:04.912632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:04.941785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:04.974895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 872/1738] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:04.978206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:04.994370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 867/1739] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:05.009046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae15a0-7fda-4e42-ba44-54a4c31838e7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:05.022462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:05.024058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:05.024414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:05.024677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:05.026096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:05.033345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524109b-080d-4f88-ba25-8271653c9985 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:05.069553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 873/1740] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:05.072052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:05.094033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11e382-52d7-4def-a04c-4e3a43f0096f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:05.120845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:05.121726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:05.122163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:05.122582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] PATH_INFO: `/v3/projects/07345eeefea74803a709952f74745e2d/users/a3ad88d4317441c58ccce69540366f31/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:05.184121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07345eeefea74803a709952f74745e2d, user_id=a3ad88d4317441c58ccce69540366f31, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:05.186813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:05.236168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 868/1741] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:05 2022] PUT /identity/v3/projects/07345eeefea74803a709952f74745e2d/users/a3ad88d4317441c58ccce69540366f31/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:05.246597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83327-1075-4968-80c2-c27959203b74 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:05.246892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83327-1075-4968-80c2-c27959203b74 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:05.247177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda83327-1075-4968-80c2-c27959203b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:05.388048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-dda83327-1075-4968-80c2-c27959203b74 None None] MFA Rules not processed for user `a3ad88d4317441c58ccce69540366f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:05.396126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dda83327-1075-4968-80c2-c27959203b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:05.705964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 874/1742] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:05.710777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:05.846085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5a76b-dbb0-4563-971a-40c830405206 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:05.862989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:05.864611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:05.867449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:05.868000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:05.870146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:05.876229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:05.895218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda83327-1075-4968-80c2-c27959203b74 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:05.897975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dda83327-1075-4968-80c2-c27959203b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:05.935061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda83327-1075-4968-80c2-c27959203b74 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:05.957485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:05.961727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:05.962220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:05.963621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] PATH_INFO: `/v3/projects/80a54a8c2fc7477c827a52ad34206de6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:05.967780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a54a8c2fc7477c827a52ad34206de6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:05.977551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:05.985416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 869/1743] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:05 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:05.989455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:06.204470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a54a8c2fc7477c827a52ad34206de6', 'request_id': 'req-9a3690b4-1633-433a-ba33-bdd63da24839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.236329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a54a8c2fc7477c827a52ad34206de6', 'request_id': 'req-9a3690b4-1633-433a-ba33-bdd63da24839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.270418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a54a8c2fc7477c827a52ad34206de6', 'request_id': 'req-9a3690b4-1633-433a-ba33-bdd63da24839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.305640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6d890-c0c5-43c5-8e8d-565dec6a90e6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:06.311339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] The token cache is being invalidate because project 80a54a8c2fc7477c827a52ad34206de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:06.312480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.316607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.319466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 875/1744] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:05 2022] DELETE /identity/v3/projects/80a54a8c2fc7477c827a52ad34206de6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:06.323918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:06.327186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:06.449060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:06.492710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:06.513636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:06.517085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:06.518762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:06.520064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:06.521195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:06.526908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:06.560497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3690b4-1633-433a-ba33-bdd63da24839 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:06.575159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:06.578748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:06.579296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:06.580089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] PATH_INFO: `/v3/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:06.581714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 870/1745] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:05 2022] POST /identity/v3/users => generated 292 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:06.582636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab73a8c0fbb43a58a2fb2ff1b4cc8a1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:06.584676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:06.587509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:06.588884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:06.669068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52ea59-a6e8-4979-935d-93350527882d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:06.694459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:06.698449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:06.698861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:06.700152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:06.701016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:06.705778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:06.771577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 871/1746] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:06.775179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:06.791969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab73a8c0fbb43a58a2fb2ff1b4cc8a1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.795269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab73a8c0fbb43a58a2fb2ff1b4cc8a1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.811484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6ba6-c673-4467-a8f4-108124932831 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:06.823822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab73a8c0fbb43a58a2fb2ff1b4cc8a1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.826776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:06.830411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:06.831596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:06.832168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] PATH_INFO: `/v3/projects/9cb54b66726140669467c3cf2d738951/users/84d5e959ca07412d89c945b170c44342/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:06.856809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab73a8c0fbb43a58a2fb2ff1b4cc8a1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.899627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb54b66726140669467c3cf2d738951, user_id=84d5e959ca07412d89c945b170c44342, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:06.907662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:06.915001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab73a8c0fbb43a58a2fb2ff1b4cc8a1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:06.947299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 872/1747] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:06 2022] PUT /identity/v3/projects/9cb54b66726140669467c3cf2d738951/users/84d5e959ca07412d89c945b170c44342/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:06.956051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:06.958066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 876/1748] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:06 2022] DELETE /identity/v3/users/eab73a8c0fbb43a58a2fb2ff1b4cc8a1 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:06.962219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:07.187787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589223c-3229-491e-b282-f6aed4b0a994 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:07.512547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:07.514793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:07.515764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:07.516443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:07.517385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:07.520630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02208f1-bda5-4587-9720-29c081e4ef5b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:07.545251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 873/1749] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:07.549168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:07.563612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d3d4-baec-410f-8229-d3bfce577a65 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:07.568909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:07.569805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:07.570262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:07.570690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] PATH_INFO: `/v3/projects/9cb54b66726140669467c3cf2d738951/users/84d5e959ca07412d89c945b170c44342/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:07.575778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb54b66726140669467c3cf2d738951, user_id=84d5e959ca07412d89c945b170c44342, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:07.579487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:07.614178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 877/1750] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:07 2022] PUT /identity/v3/projects/9cb54b66726140669467c3cf2d738951/users/84d5e959ca07412d89c945b170c44342/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:07.626646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c820b1-0b93-4540-9fb9-5a89107c9b12 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:07.626937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c820b1-0b93-4540-9fb9-5a89107c9b12 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:07.627224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c820b1-0b93-4540-9fb9-5a89107c9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:07.747832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c9c820b1-0b93-4540-9fb9-5a89107c9b12 None None] MFA Rules not processed for user `84d5e959ca07412d89c945b170c44342`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:07.754403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c9c820b1-0b93-4540-9fb9-5a89107c9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:07.939978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:08.083359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 874/1751] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:08.097789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:08.099894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:08.427704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913547f-4213-4a76-88ad-49fb8064c896 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:08.448648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:08.449517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:08.449955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:08.450374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:08.471032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:08.474278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7aa12-1d79-4cfe-8fe6-c7a7eaacc615 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:08.504618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 878/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:08.914502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:08.914810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:08.915119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:08.973228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] MFA Rules not processed for user `236a8fb93bae48dd82086f1f35d1fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:08.975229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:09.040413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:09.040702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:09.040981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:09.183852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 875/1753] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:09.227918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:09.230424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:09.236929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:09.374181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 879/1754] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:09.458888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:09.523665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:09.525276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:09.603513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a13be-1621-44cb-9876-2366a91db004 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:09.618360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:09.619484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:09.621227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:09.621678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] PATH_INFO: `/v3/users/a3ad88d4317441c58ccce69540366f31` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:09.626342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ad88d4317441c58ccce69540366f31)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:09.630902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:09.721124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c3fed-1041-4e3e-a64b-d30a5dd3d1bf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:09.735415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:09.736843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:09.737414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:09.737920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:09.757888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:09.759937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedfb03-a158-4787-8bc6-fb2b2768189f service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:09.772267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 880/1755] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 20:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 20:59:09.954665 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ad88d4317441c58ccce69540366f31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:09.955386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ad88d4317441c58ccce69540366f31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:09.998511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ad88d4317441c58ccce69540366f31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.020907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ad88d4317441c58ccce69540366f31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.021977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ad88d4317441c58ccce69540366f31'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.055126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:10.068916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 876/1756] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:09 2022] DELETE /identity/v3/users/a3ad88d4317441c58ccce69540366f31 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:10.073367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:10.073651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:10.073976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:10.129856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:10.138955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:10.345345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 881/1757] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:10.391270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:10.392843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:10.555898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423e509-2c40-494d-89e6-132bab8927fd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:10.571129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:10.574104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:10.575805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:10.577508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:10.607160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:10.610996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:10.612663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:10.614585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3da21a-40f6-47c4-9bb3-cbba6d643ee2 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:10.630535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55468a61-dfa1-4523-87fa-edc007c5dda7 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:10.664673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:10.665347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:10.665634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:10.668430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] PATH_INFO: `/v3/projects/aa4c1b68604441f1aa7b97241965e8fd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:10.670305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4c1b68604441f1aa7b97241965e8fd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:10.677621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:10.700971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 877/1758] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:10.739206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:10.871638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4c1b68604441f1aa7b97241965e8fd', 'request_id': 'req-b8e45274-8bf5-4109-8128-777fadfdddba'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.898720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4c1b68604441f1aa7b97241965e8fd', 'request_id': 'req-b8e45274-8bf5-4109-8128-777fadfdddba'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.906986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4c1b68604441f1aa7b97241965e8fd', 'request_id': 'req-b8e45274-8bf5-4109-8128-777fadfdddba'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.935883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] The token cache is being invalidate because project aa4c1b68604441f1aa7b97241965e8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:10.936182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.941826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b8e45274-8bf5-4109-8128-777fadfdddba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:10.944160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 882/1759] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:10 2022] DELETE /identity/v3/projects/aa4c1b68604441f1aa7b97241965e8fd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:10.949329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:10.949638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:10.949971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.050345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:11.052783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:11.273223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:11.273875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:11.274462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.284063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 878/1760] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:11.325589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:11.342303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:11.373196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 883/1761] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:11.377816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:11.393364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319f99f-725b-463f-b7c1-9718f86f9461 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:11.411727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:11.417592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:11.418551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:11.421634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.422671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:11.423191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:11.425232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:11.475485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 879/1762] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:11.480331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:11.494614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d9155-3037-4953-be44-a21ed7d14a25 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:11.521689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:11.522621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:11.523079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:11.523532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.524541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:11.530567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:11.604593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:11.612617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 884/1763] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:11 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:11.623060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689480e-eb63-44bd-b424-c16fb66317d3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:11.845003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:11.845698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:11.845980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:11.846256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.848005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:11.852743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:11.917214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:11.930041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 880/1764] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:11 2022] POST /identity/v3/users => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:11.931567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407170b-c7d6-4f3c-90fb-8e7f217b3563 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:11.954102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:11.954858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:11.955112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:11.955383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:11.958999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:11.963243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:12.029123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:12.035681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 885/1765] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:12.047520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715215b6-87e1-4342-b04b-f85bc5ad2af6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:12.064563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:12.065230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:12.065467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:12.065737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:12.066444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:12.068096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbb22c-d922-45d5-9a8b-a84591cd792b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:12.100343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:12.110320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 881/1766] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:12.112510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976e41-2376-49ac-9c6e-f88ae11cad2d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:12.126393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:12.127097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:12.127379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:12.127659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] PATH_INFO: `/v3/projects/80da16c166a749079672fc747b9f9ad7/users/5d6005a96e4b4c15934f0fd800b3e5b9/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:12.173963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80da16c166a749079672fc747b9f9ad7, user_id=5d6005a96e4b4c15934f0fd800b3e5b9, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:12.181696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:12.250744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 886/1767] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:12 2022] PUT /identity/v3/projects/80da16c166a749079672fc747b9f9ad7/users/5d6005a96e4b4c15934f0fd800b3e5b9/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:12.260600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:12.261066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:12.261443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:12.313528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:12.345188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] MFA Rules not processed for user `5d6005a96e4b4c15934f0fd800b3e5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:12.347367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:12.550426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 882/1768] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:12.553551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:12.691301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d4fbc-d7ff-4404-a78e-f0f1fbe1b9c8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:12.698947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:12.699593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:12.699998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:12.700823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:12.703692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:12.707867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:12.791006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 887/1769] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:12 2022] POST /identity/v3/projects => generated 399 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:12.795079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:12.818683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730864d-8403-4c43-a67f-d2f8e529f3ae None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:12.951938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:12.956482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:12.956922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:12.957525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:12.958632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:12.961011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:12.988752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 883/1770] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:12 2022] POST /identity/v3/users => generated 306 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:12.992784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:13.005774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146a10-a132-4e83-abc8-9ec3aff3855d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:13.012087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:13.013050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.013344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.014097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.015431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:13.017321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:13.033477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 888/1771] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:13.037883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:13.055056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fdfa9-aae4-4646-9c1f-461683e59d1b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:13.076827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:13.078111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.078371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.078614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] PATH_INFO: `/v3/projects/84f07678388a4d0e8c3590e2f43aa342/users/42e75e78f0344debb4012770452d86c9/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.119075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f07678388a4d0e8c3590e2f43aa342, user_id=42e75e78f0344debb4012770452d86c9, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:13.129283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:13.161585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 884/1772] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:13 2022] PUT /identity/v3/projects/84f07678388a4d0e8c3590e2f43aa342/users/42e75e78f0344debb4012770452d86c9/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:13.165638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:13.200024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19d93-6def-4396-9cfc-c5c5b3863bbb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:13.220789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:13.380338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:13.380997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.381281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.381675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.382264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:13.383907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ff68b-61a4-45bd-a6c2-501fdfd35531 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:13.400756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 889/1773] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:13.404970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:13.417730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227866e9-30fb-4250-9154-991d8099e705 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:13.424194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:13.424900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.425184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.425466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] PATH_INFO: `/v3/projects/84f07678388a4d0e8c3590e2f43aa342/users/42e75e78f0344debb4012770452d86c9/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.428471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f07678388a4d0e8c3590e2f43aa342, user_id=42e75e78f0344debb4012770452d86c9, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:13.432979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:13.471129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 885/1774] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:13 2022] PUT /identity/v3/projects/84f07678388a4d0e8c3590e2f43aa342/users/42e75e78f0344debb4012770452d86c9/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:13.481173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.481462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.481742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.569960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] MFA Rules not processed for user `42e75e78f0344debb4012770452d86c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:13.575552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:13.773544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 890/1775] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:13.793098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:13.795235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:13.912731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297c51-6f59-4a1f-b62d-2839cc6056ca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:13.917475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:13.918273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:13.918846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:13.919255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:13.933401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:13.953671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:13.960960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:14.017840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 886/1776] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:14.157826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:14.174237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4033d1-8e92-4dfc-b427-dbabc10e99d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:14.184029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:14.186351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:14.187371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:14.188527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:14.385666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:14.389533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39544b7-a9aa-4bb6-9522-5f2395b682b7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:14.418983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 891/1777] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:14.460952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:14.472937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:14.640236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:14.640236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:14.640236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:14.690440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:14.694852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:14.712090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94846-edd2-4a33-8e70-9a166243a742 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:14.735926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:14.739200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:14.741727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:14.743839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] PATH_INFO: `/v3/projects/07345eeefea74803a709952f74745e2d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:14.750255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07345eeefea74803a709952f74745e2d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:14.755611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:14.885372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:14.888867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07345eeefea74803a709952f74745e2d', 'request_id': 'req-9b1d88e8-c596-497c-b35f-ff8541f26c54'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:14.913658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07345eeefea74803a709952f74745e2d', 'request_id': 'req-9b1d88e8-c596-497c-b35f-ff8541f26c54'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:14.934833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07345eeefea74803a709952f74745e2d', 'request_id': 'req-9b1d88e8-c596-497c-b35f-ff8541f26c54'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:14.960813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] The token cache is being invalidate because project 07345eeefea74803a709952f74745e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:14.961118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:14.965286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:14.973877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 892/1779] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Aug 4 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:14.974749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 887/1779] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:14 2022] DELETE /identity/v3/projects/07345eeefea74803a709952f74745e2d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:14.974892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:14.976663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:14.992416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:14.994055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:15.019015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd59b4-d809-4c0e-8c5d-6c4b2d6edb2a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:15.196549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d88e8-c596-497c-b35f-ff8541f26c54 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:15.204783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:15.205440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:15.205729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:15.209953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:15.252848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:15.252848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867785c-62c0-4f5f-8ecf-89235cc38dc7 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:15.293032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 888/1780] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:15.348046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:15.348721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:15.349006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:15.349269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] PATH_INFO: `/v3/users/84d5e959ca07412d89c945b170c44342` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:15.351684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d5e959ca07412d89c945b170c44342)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:15.353679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:15.481402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d5e959ca07412d89c945b170c44342'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:15.482865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d5e959ca07412d89c945b170c44342'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:15.496701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d5e959ca07412d89c945b170c44342'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:15.513842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d5e959ca07412d89c945b170c44342'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:15.545815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-027345b7-12bd-4051-8b25-437be2c76f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d5e959ca07412d89c945b170c44342'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:15.559119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 893/1781] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:14 2022] DELETE /identity/v3/users/84d5e959ca07412d89c945b170c44342 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:17.540227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:17.540934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:17.541680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:17.545251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 889/1782] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:59:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:59:17.817527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32081-d81d-4e2f-9f6d-6ff35f4f2844 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:17.817981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32081-d81d-4e2f-9f6d-6ff35f4f2844 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:17.818283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb32081-d81d-4e2f-9f6d-6ff35f4f2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:17.862824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ddb32081-d81d-4e2f-9f6d-6ff35f4f2844 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:17.866290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ddb32081-d81d-4e2f-9f6d-6ff35f4f2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:17.919079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:17.926282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:18.064293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:18.071945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:18.119427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 894/1783] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:18.168909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cda61e-9d52-4dca-8d81-00df4b4c5292 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:18.177240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:18.180276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:18.181990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:18.183326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] PATH_INFO: `/v3/projects/9cb54b66726140669467c3cf2d738951` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:18.187929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb54b66726140669467c3cf2d738951)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:18.191701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:18.331343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb54b66726140669467c3cf2d738951', 'request_id': 'req-459cb757-8c19-4adb-92b7-44f88055bae9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:18.360000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb54b66726140669467c3cf2d738951', 'request_id': 'req-459cb757-8c19-4adb-92b7-44f88055bae9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:18.369323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb54b66726140669467c3cf2d738951', 'request_id': 'req-459cb757-8c19-4adb-92b7-44f88055bae9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:18.394153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] The token cache is being invalidate because project 9cb54b66726140669467c3cf2d738951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:18.394547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:18.395648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:18.409354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 890/1784] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:17 2022] DELETE /identity/v3/projects/9cb54b66726140669467c3cf2d738951 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:18.412050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbef5c-ba54-4539-b87f-cb1e2aab555a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:18.412453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbef5c-ba54-4539-b87f-cb1e2aab555a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:18.412752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbef5c-ba54-4539-b87f-cb1e2aab555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:18.460684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b5dbef5c-ba54-4539-b87f-cb1e2aab555a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:18.464543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b5dbef5c-ba54-4539-b87f-cb1e2aab555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:18.482403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:18.484662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:18.728039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 895/1785] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:18.735102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:18.735572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:18.735888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:18.765829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb757-8c19-4adb-92b7-44f88055bae9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:18.784937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:18.789862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:18.791139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:18.791488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:18.797973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:18.803186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:18.806925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:18.838789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 896/1786] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:18.845421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:18.852435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:18.875671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:18.895261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24fc63-6070-42d2-8bea-c68b7e7ddb98 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:18.904320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:18.905344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:18.905807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:18.906247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:18.907405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:18.907973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:18.914814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:18.959959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 891/1787] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:18.969213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 897/1788] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:18.970941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.010145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3ae4-52cf-4fc4-bd0b-f04e00f58aaf service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.039053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.039705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.040017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.040392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.041318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.054931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:19.146054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 892/1789] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:18 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:19.149441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.170996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dae3af-8f3d-42ec-8cc5-48a5fe01f442 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.318942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.320165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.320679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.320982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.322275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.325149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:19.390999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 898/1790] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:19 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:19.399349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.418119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b44b4a-babd-442d-8ca7-55fec35a68c7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.433578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.434387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.434780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.435154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.437051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.442440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:19.469354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 893/1791] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:19.474023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.486294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dc01a-c4eb-47e5-a1d9-8022498279fa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.493049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.494070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.494399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.494772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.495893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.497768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7e87c-3de9-4d6b-ae71-170429e0cd1b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:19.517115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 899/1792] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:19.517906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.531920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a217cf-4411-4563-b9d3-e20b1994f7ac admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.540302 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.544485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.544485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.545182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] PATH_INFO: `/v3/projects/a6afefb753e4443595050510a20c6c0f/users/29de61de4c954440856e7125530cd0ce/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.549940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:19.570200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6afefb753e4443595050510a20c6c0f, user_id=29de61de4c954440856e7125530cd0ce, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.575181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:19.609256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.609710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.610164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.619611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 894/1793] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:19 2022] PUT /identity/v3/projects/a6afefb753e4443595050510a20c6c0f/users/29de61de4c954440856e7125530cd0ce/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:19.654849 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] MFA Rules not processed for user `29de61de4c954440856e7125530cd0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:19.656443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:19.717168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:19.756562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 900/1794] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:19.761724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:19.886979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0380b8-b903-492e-835d-05ef5e9b9fdc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:19.905269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:19.906839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:19.909294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:19.909831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:19.914397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:19.920358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.000311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.009283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 895/1795] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:19 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:20.014320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41243bd8-6573-416d-aed8-b5fd748111a4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.135871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.136636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.145873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.146202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.146979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.149062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.208479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 901/1796] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:19 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:20.209755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.225466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c014b-d311-4021-b9f3-cf8433bfb936 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.242872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.244136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.244434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.244872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.245541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.247202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.289521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 896/1797] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:20.291472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.312375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a730c-db19-4846-8779-30d22d14ca06 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.326150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.326861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.327711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.328026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] PATH_INFO: `/v3/projects/70c9486442f2446bbb276cf88f6c8fbf/users/c4a9dc021b59495da8154480240693cc/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.378800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c9486442f2446bbb276cf88f6c8fbf, user_id=c4a9dc021b59495da8154480240693cc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.382123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.414957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 902/1798] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:20 2022] PUT /identity/v3/projects/70c9486442f2446bbb276cf88f6c8fbf/users/c4a9dc021b59495da8154480240693cc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:20.424028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.440466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078edfc-4b0c-40ba-a916-74d04a9498bb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.455198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.457036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:20.625873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c822ec-766e-4f9a-9d3a-013889b6a77c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.632435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.633259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.633542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.633816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] PATH_INFO: `/v3/users/5d6005a96e4b4c15934f0fd800b3e5b9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.635147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6005a96e4b4c15934f0fd800b3e5b9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.637549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.647213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.647918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.648324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.648640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.649381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.653080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.695158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 897/1799] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:20.707654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:20.738054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5d63c-f926-4738-93a6-9b41fa7122b1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:20.748737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:20.757903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6005a96e4b4c15934f0fd800b3e5b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:20.762006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6005a96e4b4c15934f0fd800b3e5b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:20.765686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:20.766408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.766660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.766934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] PATH_INFO: `/v3/projects/70c9486442f2446bbb276cf88f6c8fbf/users/c4a9dc021b59495da8154480240693cc/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.770562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c9486442f2446bbb276cf88f6c8fbf, user_id=c4a9dc021b59495da8154480240693cc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:20.773584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91ef3-9109-4d58-99de-3162d8920c74 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:20.792771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6005a96e4b4c15934f0fd800b3e5b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:20.830750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 898/1800] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:20 2022] PUT /identity/v3/projects/70c9486442f2446bbb276cf88f6c8fbf/users/c4a9dc021b59495da8154480240693cc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:20.832990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6005a96e4b4c15934f0fd800b3e5b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:20.837609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125353-2e2c-4735-8166-a78986955954 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.837946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125353-2e2c-4735-8166-a78986955954 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.838215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96125353-2e2c-4735-8166-a78986955954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.854201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b2b3f111-5de3-4083-8952-f64303909003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6005a96e4b4c15934f0fd800b3e5b9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:20.866618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 903/1801] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:20 2022] DELETE /identity/v3/users/5d6005a96e4b4c15934f0fd800b3e5b9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:20.868430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:20.868945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:20.869212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:20.924107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:20.927853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:20.932569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-96125353-2e2c-4735-8166-a78986955954 None None] MFA Rules not processed for user `c4a9dc021b59495da8154480240693cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:20.934007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-96125353-2e2c-4735-8166-a78986955954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:21.031623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:21.065890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 904/1802] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:21.111105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 899/1803] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:21.126137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:21.131765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:21.132007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125353-2e2c-4735-8166-a78986955954 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:21.135113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-96125353-2e2c-4735-8166-a78986955954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:21.335125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f073a-d0d0-460e-9d65-d681365188b4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:21.339921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:21.340362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:21.340780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:21.340943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:21.354916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96125353-2e2c-4735-8166-a78986955954 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:21.356821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:21.360396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:21.366433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:21.368008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:21.371510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:21.372052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:21.385762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 905/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:21.389370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:21.392034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bea6d5-176f-4b42-aa39-0480dcc3f063 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:21.406129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 900/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:21.479014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:21.493812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449d9f7-2c6f-4292-b25b-c765fb8470bc service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:21.498112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:21.499469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:21.503126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:21.503543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:21.505861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:21.755300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:21.756955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e534-0971-415a-b7eb-abbb72e6ff16 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:21.778286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 906/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:22.771406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:22.772851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:22.773660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:22.776027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 901/1807] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:59:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:59:22.815606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37336-5407-413b-aa30-11b83067004a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:22.816650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37336-5407-413b-aa30-11b83067004a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:22.817209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37336-5407-413b-aa30-11b83067004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:22.833438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:22.855711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38e37336-5407-413b-aa30-11b83067004a None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:22.857347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38e37336-5407-413b-aa30-11b83067004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:22.951174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 907/1808] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:23.355446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:23.357425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:23.398615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c4bc-90ee-49e9-88b1-752d84ec5496 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:23.422212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:23.422853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:23.423134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:23.423470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:23.434119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:23.436360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:23.450281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 902/1809] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:23.473067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37336-5407-413b-aa30-11b83067004a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:23.475210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38e37336-5407-413b-aa30-11b83067004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:23.515985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37336-5407-413b-aa30-11b83067004a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:23.528844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:23.533476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:23.533476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:23.533476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] PATH_INFO: `/v3/projects/80da16c166a749079672fc747b9f9ad7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:23.534635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80da16c166a749079672fc747b9f9ad7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:23.538527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:23.670312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80da16c166a749079672fc747b9f9ad7', 'request_id': 'req-060aa7be-deb1-4c7e-816d-05cb241384f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.700622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80da16c166a749079672fc747b9f9ad7', 'request_id': 'req-060aa7be-deb1-4c7e-816d-05cb241384f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.715109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:23.719164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80da16c166a749079672fc747b9f9ad7', 'request_id': 'req-060aa7be-deb1-4c7e-816d-05cb241384f0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.724374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:23.744099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959538da-0dc9-4747-88a2-84d6763de92d service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:23.745235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] The token cache is being invalidate because project 80da16c166a749079672fc747b9f9ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:23.745479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.746192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.748081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 908/1810] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:23 2022] DELETE /identity/v3/projects/80da16c166a749079672fc747b9f9ad7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:23.751834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:23.753299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:23.856144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:23.856809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:23.861180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:23.861631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] PATH_INFO: `/v3/users/5a9a334886c145658cd8d63b74ee368d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:23.862846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9a334886c145658cd8d63b74ee368d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:23.865797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:23.874415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060aa7be-deb1-4c7e-816d-05cb241384f0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:23.886342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:23.887010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:23.887295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:23.887575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] PATH_INFO: `/v3/users/42e75e78f0344debb4012770452d86c9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:23.890508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e75e78f0344debb4012770452d86c9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:23.892612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:23.967548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:23.979914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9a334886c145658cd8d63b74ee368d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:23.982084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9a334886c145658cd8d63b74ee368d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.001082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9a334886c145658cd8d63b74ee368d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.006285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:24.022313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9a334886c145658cd8d63b74ee368d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.024249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-25470e23-d6e8-4049-8b49-e935f6566128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9a334886c145658cd8d63b74ee368d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.030208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e75e78f0344debb4012770452d86c9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.031486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e75e78f0344debb4012770452d86c9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.051815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e75e78f0344debb4012770452d86c9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.067875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e75e78f0344debb4012770452d86c9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.071257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 903/1811] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:23 2022] DELETE /identity/v3/users/5a9a334886c145658cd8d63b74ee368d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:24.079305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:24.079572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:24.079813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:24.093778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e75e78f0344debb4012770452d86c9'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:24.106150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 909/1812] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:23 2022] DELETE /identity/v3/users/42e75e78f0344debb4012770452d86c9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:24.130759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:24.132472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:24.324782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 904/1813] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:24.333891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:24.335218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:24.409219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b4dfd-a97b-4499-a399-37160e4edda6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:24.414903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:24.417179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:24.417434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:24.417836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:24.449346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:24.451347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:24.479057 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 910/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:26.011876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.013910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.036494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd6fb9-4c5e-4013-a431-26d84f03f34b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.054373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.055674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.056102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.056529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] PATH_INFO: `/v3/projects/a5b4aff8398a475d8a1d0c8003ec6c6e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.058219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b4aff8398a475d8a1d0c8003ec6c6e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.060430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.086722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.090205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.118418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bcc4-e5cd-4eff-8e3a-89b53261cb82 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.133725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.134599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.135082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.135544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] PATH_INFO: `/v3/projects/84f07678388a4d0e8c3590e2f43aa342` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.137451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f07678388a4d0e8c3590e2f43aa342)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.143579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.164711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b4aff8398a475d8a1d0c8003ec6c6e', 'request_id': 'req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.177545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b4aff8398a475d8a1d0c8003ec6c6e', 'request_id': 'req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.189385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b4aff8398a475d8a1d0c8003ec6c6e', 'request_id': 'req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.212382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] The token cache is being invalidate because project a5b4aff8398a475d8a1d0c8003ec6c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:26.212663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.216739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.219100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 905/1815] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:26 2022] DELETE /identity/v3/projects/a5b4aff8398a475d8a1d0c8003ec6c6e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:26.224110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.225727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.247852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f07678388a4d0e8c3590e2f43aa342', 'request_id': 'req-4a872f1e-d65e-4953-bd31-b598faaa7fae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.258421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f07678388a4d0e8c3590e2f43aa342', 'request_id': 'req-4a872f1e-d65e-4953-bd31-b598faaa7fae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.265800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f07678388a4d0e8c3590e2f43aa342', 'request_id': 'req-4a872f1e-d65e-4953-bd31-b598faaa7fae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.277724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] The token cache is being invalidate because project 84f07678388a4d0e8c3590e2f43aa342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:26.278121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.278706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.283636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 911/1816] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:26 2022] DELETE /identity/v3/projects/84f07678388a4d0e8c3590e2f43aa342 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:26.283636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.283636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.306572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c5da8-aa93-4af1-bcd2-c6bb1b97136d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.311961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:26.313581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:26.358631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a872f1e-d65e-4953-bd31-b598faaa7fae admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.368298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.369481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.370005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.370306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] PATH_INFO: `/v3/users/29de61de4c954440856e7125530cd0ce` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.371800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29de61de4c954440856e7125530cd0ce)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.374746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.379960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.380710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.381172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.381531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] PATH_INFO: `/v3/users/5717d38d0cce453a817fb9d0a4944573` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.383079 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5717d38d0cce453a817fb9d0a4944573)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.385177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.444994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29de61de4c954440856e7125530cd0ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.445756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29de61de4c954440856e7125530cd0ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.450907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5717d38d0cce453a817fb9d0a4944573'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.452447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5717d38d0cce453a817fb9d0a4944573'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.457503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29de61de4c954440856e7125530cd0ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.463503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5717d38d0cce453a817fb9d0a4944573'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.472568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29de61de4c954440856e7125530cd0ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.474584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5717d38d0cce453a817fb9d0a4944573'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.475235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cd7df86b-b591-45b2-a763-92fd1715b830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5717d38d0cce453a817fb9d0a4944573'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.489846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a00b79ca-eda6-4a82-8e49-b0f4d4bb5039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29de61de4c954440856e7125530cd0ce'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:26.496145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 906/1817] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:26 2022] DELETE /identity/v3/users/5717d38d0cce453a817fb9d0a4944573 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:26.499851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0781cd-e46b-4454-943e-41e9adc0ba94 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.499851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0781cd-e46b-4454-943e-41e9adc0ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.499851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0781cd-e46b-4454-943e-41e9adc0ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.507829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 912/1818] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:26 2022] DELETE /identity/v3/users/29de61de4c954440856e7125530cd0ce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:26.509976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.511865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.512379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.523485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3a0781cd-e46b-4454-943e-41e9adc0ba94 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:26.524837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3a0781cd-e46b-4454-943e-41e9adc0ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.538414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:26.540484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.615895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 907/1819] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:26.618988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.619314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.619656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.649976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:26.651458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.662014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 908/1820] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:26.664086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 913/1821] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:26.666296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.671327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.672980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:26.679431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416b41f-e4f3-48ec-9f7d-3943304efb92 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.686723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.687471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.687905 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.688907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.689738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:26.690151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.691993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.707556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 909/1822] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:26.711791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.730605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:26.732007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823851d4-0172-490f-aee5-2ed72b8b54c0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.744928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.746278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.746868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.747195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.747959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.748076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4da5-8d11-4690-af12-0a7e2b890483 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.753246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.753956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.761284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.765787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.767470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.769792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:26.791690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.798289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.809236 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 910/1823] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:26 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:26.814594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.821030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 914/1824] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:26.897486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731d8ad-0ec4-42a0-8148-5797a34b54c0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.903625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.904352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.904734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.905587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.906312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.908444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.938548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 911/1825] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:26 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:26.942775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.953474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e884f-9fbd-497d-9619-0e9284bfac10 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:26.958935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:26.959654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:26.960050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:26.960459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:26.961183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:26.962987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:26.979630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 915/1826] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:26.987293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:26.999379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f348-1587-47e6-b076-d22a5cac358b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.004477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.005105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.005406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.005663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.006493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.008271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.020507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 912/1827] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:27.025825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.038238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6de8b-0781-43ff-8d9e-4d20a330b4de admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.043705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.044431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.044718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.044996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] PATH_INFO: `/v3/projects/e2d3b8fc4bcb47ea96f89bc5a76852c5/users/03e3b96626ca4b82a1155ef8d33b240a/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.059612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.061418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d3b8fc4bcb47ea96f89bc5a76852c5, user_id=03e3b96626ca4b82a1155ef8d33b240a, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.062706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.064256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f135e-dc20-4ae5-b653-5ec705ef689b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.083144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae331d6-362d-4fe6-a8ac-96b533e9d181 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.089736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 916/1828] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:27 2022] PUT /identity/v3/projects/e2d3b8fc4bcb47ea96f89bc5a76852c5/users/03e3b96626ca4b82a1155ef8d33b240a/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:27.119059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.119358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.119642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.166031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] MFA Rules not processed for user `03e3b96626ca4b82a1155ef8d33b240a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:27.167945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.208207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.210119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.213503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.214138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] PATH_INFO: `/v3/projects/4edd7e418038493dbcab400dcfc1d0d3` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.217078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edd7e418038493dbcab400dcfc1d0d3)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.220996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.306602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 917/1829] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:27.307640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.311999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.322089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edd7e418038493dbcab400dcfc1d0d3', 'request_id': 'req-63f8980a-5516-456c-b76f-e4948ca66492'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.332965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edd7e418038493dbcab400dcfc1d0d3', 'request_id': 'req-63f8980a-5516-456c-b76f-e4948ca66492'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.338451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2869-a75e-43ad-8752-0ee448414440 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.341357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edd7e418038493dbcab400dcfc1d0d3', 'request_id': 'req-63f8980a-5516-456c-b76f-e4948ca66492'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.343565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:27.362281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] The token cache is being invalidate because project 4edd7e418038493dbcab400dcfc1d0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:27.362879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.363842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.366965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 913/1830] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:27 2022] DELETE /identity/v3/projects/4edd7e418038493dbcab400dcfc1d0d3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:27.368070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.369959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.485191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.485850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.486133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.486405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] PATH_INFO: `/v3/projects/a6afefb753e4443595050510a20c6c0f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.487663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6afefb753e4443595050510a20c6c0f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.489811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.539450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8980a-5516-456c-b76f-e4948ca66492 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.542855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:27.546667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6afefb753e4443595050510a20c6c0f', 'request_id': 'req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.560826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6afefb753e4443595050510a20c6c0f', 'request_id': 'req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.568058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6afefb753e4443595050510a20c6c0f', 'request_id': 'req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.580687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] The token cache is being invalidate because project a6afefb753e4443595050510a20c6c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:27.580977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.581669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0b6b5bb0-9817-4be8-9bfb-bc046b8e8d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.583268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 918/1831] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:27 2022] DELETE /identity/v3/projects/a6afefb753e4443595050510a20c6c0f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:27.584628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.584918 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.585203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.597484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.598366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.598647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.598927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.600773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.606275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:27.607471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.671379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.672904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a7bc7-eb4f-4e77-a6d4-70be98e4df60 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.679884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 919/1832] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:27.681161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.683000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.683194 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 914/1833] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:27.686711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.687023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.687285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.699959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1daf8-b1c1-4b09-8e1d-6514acf6ec12 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.707870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:27.708179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.709189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.709629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.716419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.716882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] PATH_INFO: `/v3/users/c4a9dc021b59495da8154480240693cc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.718148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 915/1834] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:27.718671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a9dc021b59495da8154480240693cc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.720695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.721897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.737196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218ef10-371a-4759-92c7-8ab2553f46e7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.744521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.745286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.745688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.746225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.747060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:27.747468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.751580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.769395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 916/1835] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:59:27.773808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.784702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a9dc021b59495da8154480240693cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.785235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8898dc-9a6a-4577-863b-b5c2f9122db2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:27.785533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a9dc021b59495da8154480240693cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.791069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:27.792319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:27.792601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:27.793364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:27.793673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:27.795863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:27.802813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a9dc021b59495da8154480240693cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.820445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a9dc021b59495da8154480240693cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.836846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 917/1836] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:27 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:27.844854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:27.846651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:27.851914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:27.862185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a9dc021b59495da8154480240693cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:27.868435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 920/1837] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:27 2022] DELETE /identity/v3/users/c4a9dc021b59495da8154480240693cc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:27.929278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be1bb-94b3-439e-8268-e47534d37ab0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.008938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.009816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.010210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.010537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.011293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.016470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.055501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 918/1838] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:27 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:28.059438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.075459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee002b-6ace-44ff-b837-ba2940954aaa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.086471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.087921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.088360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.088683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.089406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.091248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.108804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 921/1839] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:28.109815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.121687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d4aac-c043-484a-b3cf-e300a2883d96 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.134890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.136014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.136306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.136638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.137354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.141549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.156541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 919/1840] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:28.160721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.172812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c2cfa-fea2-4c69-a8f7-de7e25ccf699 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.178062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.178817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.179159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.179681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] PATH_INFO: `/v3/projects/e997c21f378e4baea58b41ab58d287de/users/7f9d0fb8198341c18b07367ba77c5540/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.245824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e997c21f378e4baea58b41ab58d287de, user_id=7f9d0fb8198341c18b07367ba77c5540, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.247884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b27b3d-9f84-4fe6-be80-6e929dd2076d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.278439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.280857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:28.292746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 922/1841] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:28 2022] PUT /identity/v3/projects/e997c21f378e4baea58b41ab58d287de/users/7f9d0fb8198341c18b07367ba77c5540/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:28.299000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.299154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5b25-34c1-4ca2-bd0a-83ea70c2ed7b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.299264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.299264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.328798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:28.345327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] MFA Rules not processed for user `7f9d0fb8198341c18b07367ba77c5540`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:28.347492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:28.370445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.371538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.371879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.372199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] PATH_INFO: `/v3/projects/70c9486442f2446bbb276cf88f6c8fbf` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.374022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c9486442f2446bbb276cf88f6c8fbf)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.375979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.414589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:28.425907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 923/1842] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:28.430362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.439455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c9486442f2446bbb276cf88f6c8fbf', 'request_id': 'req-9c5cdb7a-da58-4885-a7ad-0757296faf93'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:28.442553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60a549-7b59-4446-889c-79d92d8c8ba4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.449121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c9486442f2446bbb276cf88f6c8fbf', 'request_id': 'req-9c5cdb7a-da58-4885-a7ad-0757296faf93'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:28.461568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c9486442f2446bbb276cf88f6c8fbf', 'request_id': 'req-9c5cdb7a-da58-4885-a7ad-0757296faf93'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:28.477123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] The token cache is being invalidate because project 70c9486442f2446bbb276cf88f6c8fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:28.477418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:28.478446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9c5cdb7a-da58-4885-a7ad-0757296faf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:28.481125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 920/1843] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:28 2022] DELETE /identity/v3/projects/70c9486442f2446bbb276cf88f6c8fbf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:28.487469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b0b-54a4-42f8-beed-957c47c61679 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.487705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b0b-54a4-42f8-beed-957c47c61679 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.488732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040b0b-54a4-42f8-beed-957c47c61679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.519055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-14040b0b-54a4-42f8-beed-957c47c61679 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:28.520239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-14040b0b-54a4-42f8-beed-957c47c61679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:28.574255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.574892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.575176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.575454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.576222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.578875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.620669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 924/1844] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:28.621735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 921/1845] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:28.622513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.633238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:28.635210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.635504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.635876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.678263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:28.679857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:28.737735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da53c55-4d93-4d78-9663-6e1da287cdbf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.751941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.752696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.753761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.754225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.754924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.769483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.791793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 922/1846] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:28.806355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.813212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 925/1847] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:28.814893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.825196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8b948-1dae-4ba1-8aa7-b779fd199ef9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.826228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7aece-ecce-4a14-b669-fe40cdee0ecd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.830927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.831852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.832345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.832726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.833241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.833488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.833880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.834412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.834776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:28.835247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.837229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.839096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.843786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.852983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 923/1848] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:28.857432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.861288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 926/1849] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:28.871799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.874159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a616-c9c5-4d5e-afc6-414622d8796b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.886478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:28.890175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.890978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.891357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.891737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.894316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.896434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.896567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5749a6-3fce-43b0-ac89-cd5686f23f61 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:28.901965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:28.902666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:28.903047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:28.903516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] PATH_INFO: `/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e/users/a298a6db0c6247539a1dcbdea77dfc4d/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:28.936690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce43c492cc8a4e5a8849e9ea67ff457e, user_id=a298a6db0c6247539a1dcbdea77dfc4d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:28.952562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:28.952715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 924/1850] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:28.952715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.963188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 927/1851] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:28 2022] PUT /identity/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e/users/a298a6db0c6247539a1dcbdea77dfc4d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:28.964235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:28.994482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:29.046331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b8cda-035d-4ff5-a931-90d08bd21bbd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.127599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.128414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.128818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.129281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.130139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.134503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.140963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e986dfb-29de-44f6-be2e-3ead1652054c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.155998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.156642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.156973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.157256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.163782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.165773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.185137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 925/1852] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:28 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:29.186267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:29.196079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 928/1853] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:29.197206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:29.203805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7749e85-3c8b-4d0a-b565-e477707e2c81 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.212075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.213004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.213481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.214091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.215219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.216721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afcef6-ae88-423e-9711-60704a93f279 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.219264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.228955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.229902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.230355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.230887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] PATH_INFO: `/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e/users/a298a6db0c6247539a1dcbdea77dfc4d/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.237985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 926/1854] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:29.238844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce43c492cc8a4e5a8849e9ea67ff457e, user_id=a298a6db0c6247539a1dcbdea77dfc4d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.240873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:29.244502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa96837-dc39-47ed-9c41-ae4c1add37ca admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.259837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40e8c-b8b6-4079-b5da-8ff987a5e583 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.286437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 929/1855] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:29 2022] PUT /identity/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e/users/a298a6db0c6247539a1dcbdea77dfc4d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:29.300477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.300772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.301051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.406583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] MFA Rules not processed for user `a298a6db0c6247539a1dcbdea77dfc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:29.408211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:29.425193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.426568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.427027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.428173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.429592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.431770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.463047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 927/1856] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:29.466861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:29.486640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfecb8-5d0f-477d-b156-a5c60e1c71c5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.500608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.501314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.505876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.512982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] PATH_INFO: `/v3/projects/ed0f2ffa89ce45a291109b5f1fdd73d6/users/cf38edf0eb9c4011adc6544072e1b279/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.552841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 930/1857] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:29.557201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0f2ffa89ce45a291109b5f1fdd73d6, user_id=cf38edf0eb9c4011adc6544072e1b279, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.559890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd121f8-6f87-44d1-8475-3cc29c993933 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.564670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:29.566100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:29.591601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 928/1858] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:29 2022] PUT /identity/v3/projects/ed0f2ffa89ce45a291109b5f1fdd73d6/users/cf38edf0eb9c4011adc6544072e1b279/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:29.603848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9bb3-c206-4a84-a555-b0489d8027a7 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.603848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9bb3-c206-4a84-a555-b0489d8027a7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.603848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9bb3-c206-4a84-a555-b0489d8027a7 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.621012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 929/1859] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 20:59:29 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 20:59:29.631886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021c75-df22-4210-840e-9911ee2a9c28 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.632232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021c75-df22-4210-840e-9911ee2a9c28 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.632519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021c75-df22-4210-840e-9911ee2a9c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.674717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ab021c75-df22-4210-840e-9911ee2a9c28 None None] MFA Rules not processed for user `cf38edf0eb9c4011adc6544072e1b279`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:29.676147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ab021c75-df22-4210-840e-9911ee2a9c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:29.676858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:29.688404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:29.692395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44facb-5e53-4cb1-a1be-8b0e8855a99c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:29.790568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:29.791115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.791394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.791666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.793746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:29.802780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 930/1860] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:29.805744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:29.806288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:29.807273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:29.838263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:29.846484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:29.890227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:29.892715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:29.911438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 931/1861] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:29.915532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.015167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 931/1862] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:30.018143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f83dc-933c-46b9-be17-5708d04b57a0 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.031939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.031939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.031939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.031939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.032292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.032292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.068768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 932/1863] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:29 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:30.072545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.091183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53edb-dfc9-45f9-b9a7-f2131a41eb5f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.141187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.151146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:30.198483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.200763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.202293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.202814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.203858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.207096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.243774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 932/1864] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:30 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:30.247795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.262120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb163f6-dc58-4b8b-a6c5-f463af8c7468 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.268161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.269030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.269566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.269810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.270662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.272557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.286242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:30.289572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 933/1865] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:30.294188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.320731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d9fb1-63c4-4006-b6d0-bc80b345fe6e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.334323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.335017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.335299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.335580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] PATH_INFO: `/v3/projects/147e5f18793c47e1939e03db72c619e5/users/37aa590845264c5a94c6f239eecebd2f/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.344477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436682b-fcf1-4c4f-b73a-7181c486a85f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.357531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147e5f18793c47e1939e03db72c619e5, user_id=37aa590845264c5a94c6f239eecebd2f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.361419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.362205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.362331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.362416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.362597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.374397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:30.374932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.376747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.387925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 934/1866] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:30 2022] PUT /identity/v3/projects/147e5f18793c47e1939e03db72c619e5/users/37aa590845264c5a94c6f239eecebd2f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:30.394377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.417582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 933/1867] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:30.485287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdef72-338e-40a6-8a06-0d669a6cea11 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.490132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.490793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.491076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.491349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.492075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.494108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba5a85-9bde-4972-853b-95bb9f1aa91b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.505006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 935/1868] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:30.509374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.520106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81697a-a78c-4b20-afd3-611d0488649e service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.524806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.525596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.525898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.526173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] PATH_INFO: `/v3/projects/147e5f18793c47e1939e03db72c619e5/users/37aa590845264c5a94c6f239eecebd2f/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.528156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=147e5f18793c47e1939e03db72c619e5, user_id=37aa590845264c5a94c6f239eecebd2f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.530831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.542566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 934/1869] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:30 2022] PUT /identity/v3/projects/147e5f18793c47e1939e03db72c619e5/users/37aa590845264c5a94c6f239eecebd2f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:30.554130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.554351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.554631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.584174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] MFA Rules not processed for user `37aa590845264c5a94c6f239eecebd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:30.585462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:30.671426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 936/1870] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:30.683093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:30.685051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:30.784465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3609a-f9e9-453e-a3e3-4693203e8eda admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:30.791447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:30.791447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:30.791447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:30.791962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:30.805610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:30.807504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de8d4-b281-4691-b322-049ecfe39ba7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:30.824635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 935/1871] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:30.952349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:31.036305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c5ad-5d68-4f8a-8a9e-3a47e9f6ef81 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:31.041453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:31.046070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:31.046616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:31.047435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] PATH_INFO: `/v3/users/cf38edf0eb9c4011adc6544072e1b279` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:31.050290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf38edf0eb9c4011adc6544072e1b279)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:31.052702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:31.087316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:31.142262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf38edf0eb9c4011adc6544072e1b279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:31.143034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf38edf0eb9c4011adc6544072e1b279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:31.152296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf38edf0eb9c4011adc6544072e1b279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:31.162934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf38edf0eb9c4011adc6544072e1b279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:31.163714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf38edf0eb9c4011adc6544072e1b279'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:31.201127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 937/1872] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:30 2022] DELETE /identity/v3/users/cf38edf0eb9c4011adc6544072e1b279 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:31.205856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:31.206374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:31.206494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:31.278023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:31.280115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:31.449830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 936/1873] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:31.756208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:31.775830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:31.882040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b645bd-7b58-4535-a472-1441f0d34481 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:31.888368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:31.890464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:31.891117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:31.891635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:31.908287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:31.909935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:31.923798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 938/1874] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:32.769665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:32.772203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:32.787393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0abc3-9378-4522-b607-f1e493d42884 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:32.796740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:32.797412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:32.797696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:32.797971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] PATH_INFO: `/v3/projects/ed0f2ffa89ce45a291109b5f1fdd73d6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:32.799623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0f2ffa89ce45a291109b5f1fdd73d6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:32.801264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:32.861946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:32.863428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:32.867064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0f2ffa89ce45a291109b5f1fdd73d6', 'request_id': 'req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:32.870386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:32.879153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0f2ffa89ce45a291109b5f1fdd73d6', 'request_id': 'req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:32.889426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0f2ffa89ce45a291109b5f1fdd73d6', 'request_id': 'req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:32.908492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] The token cache is being invalidate because project ed0f2ffa89ce45a291109b5f1fdd73d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:32.908782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:32.909476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:32.912601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 937/1875] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:32 2022] DELETE /identity/v3/projects/ed0f2ffa89ce45a291109b5f1fdd73d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:32.917016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:32.917989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:32.938032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68562e-6aaf-4895-838d-d4c66cc68c29 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:33.010436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:33.011171 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:33.011460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:33.011763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:33.015004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:33.015414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbc0e6-fb88-4f7f-bb1f-603fa10efad5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:33.021430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:33.035770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:33.038628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:33.039252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:33.039706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] PATH_INFO: `/v3/users/37aa590845264c5a94c6f239eecebd2f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:33.041969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37aa590845264c5a94c6f239eecebd2f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:33.046432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:33.136811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37aa590845264c5a94c6f239eecebd2f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.138228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37aa590845264c5a94c6f239eecebd2f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.151933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37aa590845264c5a94c6f239eecebd2f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.165745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37aa590845264c5a94c6f239eecebd2f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.169852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:33.177409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:33.195444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 939/1876] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:33.208005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0658a32c-587f-46ef-9742-03734b2334d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37aa590845264c5a94c6f239eecebd2f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.231391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 938/1877] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:32 2022] DELETE /identity/v3/users/37aa590845264c5a94c6f239eecebd2f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:33.721409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:33.735371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286e527-2534-4ca6-b363-7a393cf93877 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:33.815711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:33.816487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:33.816904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:33.817180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] PATH_INFO: `/v3/projects/147e5f18793c47e1939e03db72c619e5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:33.818538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147e5f18793c47e1939e03db72c619e5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:33.821102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:33.875848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147e5f18793c47e1939e03db72c619e5', 'request_id': 'req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.883810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147e5f18793c47e1939e03db72c619e5', 'request_id': 'req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.890211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147e5f18793c47e1939e03db72c619e5', 'request_id': 'req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.902532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] The token cache is being invalidate because project 147e5f18793c47e1939e03db72c619e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:33.902939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.903719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c44bc3ab-0ef9-4703-b94b-8cc5c9026016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:33.906019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 940/1878] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:33 2022] DELETE /identity/v3/projects/147e5f18793c47e1939e03db72c619e5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:33.911399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:33.911922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:33.911998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:33.933933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:33.935188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:33.995818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:34.004177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 939/1879] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:34.011961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.012257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.012539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.034818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:34.036332 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:34.044210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 941/1880] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:34.048490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.058404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6e1b8-80d6-4aa6-8a9f-b03dcd65fd0a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.063063 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.063681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.063992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.064276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.065003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:34.065311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.066909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.079126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 940/1881] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:34.083475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.093430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef47f8-6b92-47fc-b159-e0c67c8a0e21 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.098152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.098766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.099054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.099339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.100043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.101992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.128408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 942/1882] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:34.132651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.144164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619f4cf-d5b0-400f-8384-84fb63f0f144 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.204071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.204626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.204912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.205187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.205858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.207838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.229623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 941/1883] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:34.233884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.248123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9bff1-0fe9-4011-987d-9dc73cc3146f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.252857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.253478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.253764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.254043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.254765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.256406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.259579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:34.269644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 943/1884] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:34.275268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.289949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074cd6b-d797-44d5-ae20-b5157655ca5e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.296097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.296911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.297193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.297469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.298191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.299813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7ecba-0579-446e-ba3d-7a6c26e5fbd6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.312967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 942/1885] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:34.317299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.330228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4da971-f263-43ea-aed8-58ed979470d0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.334813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.335478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.335786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.336068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] PATH_INFO: `/v3/projects/f66cef5d4f2d45039d4a2996664d2e45/users/69f2a84281c44573adc937fce83e4b3c/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.352727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66cef5d4f2d45039d4a2996664d2e45, user_id=69f2a84281c44573adc937fce83e4b3c, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.355817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.374036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 944/1886] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:34 2022] PUT /identity/v3/projects/f66cef5d4f2d45039d4a2996664d2e45/users/69f2a84281c44573adc937fce83e4b3c/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:34.385887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.386176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.386453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.415879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] MFA Rules not processed for user `69f2a84281c44573adc937fce83e4b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:34.417119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:34.502269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 943/1887] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:34.508190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.582375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa45ac-6b9f-450d-b903-9ed168e46777 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.587114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.587845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.588201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.588550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.589331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.591358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.623703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 945/1888] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:34.625116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.642613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003e48-d100-4c25-a453-1e49aeef8081 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.773745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:34.788077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.788077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.788077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.788077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.788379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.790266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.825845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 944/1889] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:34 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:34.830179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.843460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a060160-ebbc-4b71-af11-dc423a928ebe admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.855358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.856422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.856722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.857487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.859101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.860952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.877031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 946/1890] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:34.881575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.894827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f763a1c-3eaa-4ff3-9a1e-8a36f86be6b8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:34.902256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:34.903739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:34.904060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:34.904712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] PATH_INFO: `/v3/projects/54d542b00ccf48508bc6865d23f89692/users/445626e42274472bbf1f545f2250afc9/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:34.926152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d542b00ccf48508bc6865d23f89692, user_id=445626e42274472bbf1f545f2250afc9, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:34.928936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:34.944797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 945/1891] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:34 2022] PUT /identity/v3/projects/54d542b00ccf48508bc6865d23f89692/users/445626e42274472bbf1f545f2250afc9/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:34.950109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:34.965158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158288a0-33fe-4110-9750-d4aafa33a9f0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:35.079722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:35.082726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:35.083568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:35.085335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:35.087668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:35.094111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08a939-4117-48ff-940d-bbea755bcf35 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:35.128664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 947/1892] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:35.144197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:35.158485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd736-575a-49df-969c-4421b73ba1bb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:35.163723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:35.164653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:35.164942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:35.165220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] PATH_INFO: `/v3/projects/54d542b00ccf48508bc6865d23f89692/users/445626e42274472bbf1f545f2250afc9/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:35.169058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d542b00ccf48508bc6865d23f89692, user_id=445626e42274472bbf1f545f2250afc9, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:35.176524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:35.195113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 946/1893] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:35 2022] PUT /identity/v3/projects/54d542b00ccf48508bc6865d23f89692/users/445626e42274472bbf1f545f2250afc9/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:35.207413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:35.208981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:35.209472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:35.251671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] MFA Rules not processed for user `445626e42274472bbf1f545f2250afc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:35.252986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:35.291112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:35.341525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 948/1894] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:35.358907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:35.362320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:35.441820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14c8c2-462b-4065-aa9f-7d6199bfbb0b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:35.445957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:35.446510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:35.446791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:35.447160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:35.465067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:35.466542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:35.479651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 947/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:35.959434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:35.973659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57522c7d-942c-4008-a0b6-fb0704c7fa09 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:35.978183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445626e42274472bbf1f545f2250afc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54d542b00ccf48508bc6865d23f89692', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:35.978881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:35.979167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:35.979448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:35.980209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:35.980706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:35.982347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:36.019794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 949/1896] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:36.024209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:36.040675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34686c4b-13d8-4ebd-8f92-01027f0f18e0 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:36.046861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445626e42274472bbf1f545f2250afc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54d542b00ccf48508bc6865d23f89692', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:36.047518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:36.047794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:36.048228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:36.049053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:36.051127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:36.090476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 948/1897] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:36 2022] POST /identity/v3/projects => generated 355 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:36.094704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:36.107806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead345fe-bf45-468a-b9c2-d568710d4949 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:36.250377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445626e42274472bbf1f545f2250afc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54d542b00ccf48508bc6865d23f89692', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:36.251025 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:36.251323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:36.251591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:36.252341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:36.252652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:36.254315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:36.277088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 950/1898] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:36.461733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:36.480239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47fbd-8e67-4878-ace2-d0d28c310324 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:36.486545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445626e42274472bbf1f545f2250afc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54d542b00ccf48508bc6865d23f89692', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:36.487440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:36.488233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:36.488697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] PATH_INFO: `/v3/projects/0b702a2ed58a47b59c30b1de7d002429` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:36.489952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b702a2ed58a47b59c30b1de7d002429)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:36.491977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:36.550161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b702a2ed58a47b59c30b1de7d002429', 'request_id': 'req-442a3161-d990-47cf-b600-097edb3e1abc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:36.558660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b702a2ed58a47b59c30b1de7d002429', 'request_id': 'req-442a3161-d990-47cf-b600-097edb3e1abc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:36.567477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b702a2ed58a47b59c30b1de7d002429', 'request_id': 'req-442a3161-d990-47cf-b600-097edb3e1abc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:36.583337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] The token cache is being invalidate because project 0b702a2ed58a47b59c30b1de7d002429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:36.583861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:36.584602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-442a3161-d990-47cf-b600-097edb3e1abc tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:36.586575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 949/1899] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:36 2022] DELETE /identity/v3/projects/0b702a2ed58a47b59c30b1de7d002429 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:36.858784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:36.860686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:36.961571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5b21-4fc1-4350-b205-517a6ae178c0 tempest-VolumeQuotaClassesTest-1100800685 tempest-VolumeQuotaClassesTest-1100800685-project-admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:37.021456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:37.028733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:37.029439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:37.029727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:37.030158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] PATH_INFO: `/v3/users/69f2a84281c44573adc937fce83e4b3c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:37.031402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f2a84281c44573adc937fce83e4b3c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:37.033662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:37.111341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f2a84281c44573adc937fce83e4b3c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.112148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f2a84281c44573adc937fce83e4b3c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.122034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f2a84281c44573adc937fce83e4b3c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.132559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f2a84281c44573adc937fce83e4b3c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.135541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f2a84281c44573adc937fce83e4b3c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.157881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 951/1900] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:36 2022] DELETE /identity/v3/users/69f2a84281c44573adc937fce83e4b3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:37.162465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:37.162947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:37.163038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:37.186252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:37.188656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:37.196223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:37.276707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 950/1901] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:37.289059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:37.301243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:37.381618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb3e46-ffe0-48b6-9c35-859fabfa0340 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:37.385279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:37.385994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:37.386337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:37.386681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:37.396703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:37.398158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:37.408098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 952/1902] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:37.777384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:37.779982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:37.810406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508e2ec-bcc1-4d42-b967-19bed9a2deaf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:37.817973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:37.818877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:37.819335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:37.819843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] PATH_INFO: `/v3/projects/f66cef5d4f2d45039d4a2996664d2e45` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:37.821189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66cef5d4f2d45039d4a2996664d2e45)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:37.824641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:37.905109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66cef5d4f2d45039d4a2996664d2e45', 'request_id': 'req-af630d72-9a1f-41ed-b201-902e843ddeae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.919531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66cef5d4f2d45039d4a2996664d2e45', 'request_id': 'req-af630d72-9a1f-41ed-b201-902e843ddeae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.951763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66cef5d4f2d45039d4a2996664d2e45', 'request_id': 'req-af630d72-9a1f-41ed-b201-902e843ddeae'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.988784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] The token cache is being invalidate because project f66cef5d4f2d45039d4a2996664d2e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:37.989090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.991731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:37.995080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 951/1903] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:37 2022] DELETE /identity/v3/projects/f66cef5d4f2d45039d4a2996664d2e45 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:38.000149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:38.013667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c3a1-bd60-4e99-adc6-ec1a7991ac3b service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:38.140810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:38.143286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:38.143603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:38.144105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] PATH_INFO: `/v3/users/445626e42274472bbf1f545f2250afc9` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:38.147400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] RBAC: Authorizing `identity:delete_user(user_id=445626e42274472bbf1f545f2250afc9)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:38.158654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:38.199471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:38.254026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445626e42274472bbf1f545f2250afc9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:38.254830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445626e42274472bbf1f545f2250afc9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:38.269992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445626e42274472bbf1f545f2250afc9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:38.280404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445626e42274472bbf1f545f2250afc9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:38.281106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-04cec0bd-c89a-42be-8b78-367aeab8665f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445626e42274472bbf1f545f2250afc9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:38.308939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 953/1904] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:37 2022] DELETE /identity/v3/users/445626e42274472bbf1f545f2250afc9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:39.099352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.101062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:39.116516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630d72-9a1f-41ed-b201-902e843ddeae admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.213586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.214239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.214520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.214793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] PATH_INFO: `/v3/projects/54d542b00ccf48508bc6865d23f89692` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.216142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d542b00ccf48508bc6865d23f89692)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.218054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.266220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:39.278058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d542b00ccf48508bc6865d23f89692', 'request_id': 'req-cf81f67d-113c-4842-9dba-3b7e7454e314'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:39.287673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d542b00ccf48508bc6865d23f89692', 'request_id': 'req-cf81f67d-113c-4842-9dba-3b7e7454e314'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:39.295828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d542b00ccf48508bc6865d23f89692', 'request_id': 'req-cf81f67d-113c-4842-9dba-3b7e7454e314'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:39.309888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] The token cache is being invalidate because project 54d542b00ccf48508bc6865d23f89692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:39.311216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:39.311571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf81f67d-113c-4842-9dba-3b7e7454e314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:39.313577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 952/1905] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:39 2022] DELETE /identity/v3/projects/54d542b00ccf48508bc6865d23f89692 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:39.318918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.319404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.319493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.344809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:39.346008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:39.412123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 954/1906] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:39.420534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.420809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.421083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.443855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:39.445065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:39.458706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 953/1907] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:39.463401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.473834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8300d3-8723-4c4c-9cc7-ad227b6e3ea7 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.478559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.479177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.479481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.479790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.480597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:39.480901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.483073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.495608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 955/1908] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:39.500684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.510152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c5972-c42b-4adb-a996-ae5db5badd09 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.514757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.515375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.515660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.515966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.516637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.518560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.551544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 954/1909] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:39 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:39.556178 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.567611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7d5ae-518e-476c-8f3d-778e64cb02b7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.633250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.634069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.634517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.634798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.635628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.638232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.666055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 956/1910] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:39 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:39.670980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.687381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f652679-18e0-48f0-87a8-6961906e7a24 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.693025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.695046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.695046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.695046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.695046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.697369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.711110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 955/1911] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:39.715227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.727404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394b5f-0050-4f2d-975c-4a31c3e66b33 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.733578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.734369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.734730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.735049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.736209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.738116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c66f2-d6b0-4b81-974a-b4ca5551cc0a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.755599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 957/1912] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:39.756292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.767460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd548-fe53-445a-a3a2-bf4ae27e4be6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:39.778168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:39.778996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.779903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.780205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] PATH_INFO: `/v3/projects/5b11e6c13a494a01bbfcc3674ae72039/users/5a65b625270349fcac10e5cc116f40b2/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.798049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b11e6c13a494a01bbfcc3674ae72039, user_id=5a65b625270349fcac10e5cc116f40b2, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:39.801165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:39.819940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 956/1913] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:39 2022] PUT /identity/v3/projects/5b11e6c13a494a01bbfcc3674ae72039/users/5a65b625270349fcac10e5cc116f40b2/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:39.831853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:39.832491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:39.832850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:39.843231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:39.869738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] MFA Rules not processed for user `5a65b625270349fcac10e5cc116f40b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:39.871125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:39.960772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 958/1914] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:39.972695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:39.974715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:40.083789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baaa19-576b-4aea-a9a1-057034d45320 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:40.088117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:40.088802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:40.089090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:40.089352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:40.099975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:40.101595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:40.111353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 957/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:47.042953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:47.044511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:47.121687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45febec-dd8a-4cab-ba3f-4826c77b6036 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:47.126454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:47.127118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.127550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.127865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] PATH_INFO: `/v3/users/7f9d0fb8198341c18b07367ba77c5540` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.129231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9d0fb8198341c18b07367ba77c5540)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:47.131286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:47.187626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:47.189461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:47.205574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fb985-2dff-4a59-b425-171ecfa9ff70 service glance] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:47.206245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9d0fb8198341c18b07367ba77c5540'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.207050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9d0fb8198341c18b07367ba77c5540'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.212520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:47.213895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.214404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.214730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] PATH_INFO: `/v3/users/03e3b96626ca4b82a1155ef8d33b240a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.216263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e3b96626ca4b82a1155ef8d33b240a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:47.217167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9d0fb8198341c18b07367ba77c5540'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.218723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:47.229240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9d0fb8198341c18b07367ba77c5540'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.230124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-950cc5e5-ecce-4fc2-8c42-db02c033f44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9d0fb8198341c18b07367ba77c5540'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.250631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 959/1916] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:47 2022] DELETE /identity/v3/users/7f9d0fb8198341c18b07367ba77c5540 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:47.254936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.255237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.256043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.280700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e3b96626ca4b82a1155ef8d33b240a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.281157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:47.281745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e3b96626ca4b82a1155ef8d33b240a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.282383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:47.292036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e3b96626ca4b82a1155ef8d33b240a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.292389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:47.301363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:47.306628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e3b96626ca4b82a1155ef8d33b240a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.324850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d3c5ab64-851b-4458-8859-2ef3d81e88cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e3b96626ca4b82a1155ef8d33b240a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:47.331971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 958/1917] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:47 2022] DELETE /identity/v3/users/03e3b96626ca4b82a1155ef8d33b240a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:47.336377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.336664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.336961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.358606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 960/1918] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:47.358827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:47.360192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:47.370130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:47.371882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:47.439169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f133-87bf-4a8b-8732-a0c0e60ba27e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:47.441669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 959/1919] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:47.456757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:47.513418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:47.513977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.514255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.514561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.524359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0c490-3550-4171-905c-ca3ffb813438 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:47.525387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:47.526935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:47.528427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:47.529091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:47.529430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:47.529767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:47.539738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:47.541563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:47.541695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 961/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:47.553134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 960/1921] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:48.234337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.236526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.252151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03583d-8d10-47cb-9fe6-3d5f0b034eaa service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.259698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.261783 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.278259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.280996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.281531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.282829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] PATH_INFO: `/v3/projects/e2d3b8fc4bcb47ea96f89bc5a76852c5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.285559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d3b8fc4bcb47ea96f89bc5a76852c5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.292329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361169-21a2-49e8-9268-c87c9ccd5429 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.293179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.307884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.308572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.308857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.309129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] PATH_INFO: `/v3/projects/e997c21f378e4baea58b41ab58d287de` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.313166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e997c21f378e4baea58b41ab58d287de)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.315112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.365779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d3b8fc4bcb47ea96f89bc5a76852c5', 'request_id': 'req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.379810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d3b8fc4bcb47ea96f89bc5a76852c5', 'request_id': 'req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.381642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e997c21f378e4baea58b41ab58d287de', 'request_id': 'req-c6cc6b24-fe58-4357-bd2a-834fbd23607c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.387957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d3b8fc4bcb47ea96f89bc5a76852c5', 'request_id': 'req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.390251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:48.391670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e997c21f378e4baea58b41ab58d287de', 'request_id': 'req-c6cc6b24-fe58-4357-bd2a-834fbd23607c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.400372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] The token cache is being invalidate because project e2d3b8fc4bcb47ea96f89bc5a76852c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:48.400775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.401526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8a2e7cec-6c99-4ad9-be99-c31a9072bf3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.402660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e997c21f378e4baea58b41ab58d287de', 'request_id': 'req-c6cc6b24-fe58-4357-bd2a-834fbd23607c'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.403949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 962/1922] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:48 2022] DELETE /identity/v3/projects/e2d3b8fc4bcb47ea96f89bc5a76852c5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:48.415782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc16-22f1-4563-94f2-974727df7b28 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.420117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] The token cache is being invalidate because project e997c21f378e4baea58b41ab58d287de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:48.420500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc16-22f1-4563-94f2-974727df7b28 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.420664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.420786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bc16-22f1-4563-94f2-974727df7b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.421293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.423109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 961/1923] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:48 2022] DELETE /identity/v3/projects/e997c21f378e4baea58b41ab58d287de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:48.427192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.428674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.435782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:48.446101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-fb10bc16-22f1-4563-94f2-974727df7b28 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:48.447312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb10bc16-22f1-4563-94f2-974727df7b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.519092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc6b24-fe58-4357-bd2a-834fbd23607c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.524544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.525282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.525711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.526119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] PATH_INFO: `/v3/users/a298a6db0c6247539a1dcbdea77dfc4d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.527471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a298a6db0c6247539a1dcbdea77dfc4d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.531442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.547275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 963/1924] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:48.556086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.556617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.557008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.578967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:48.582334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.591846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 964/1925] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:48.592051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a298a6db0c6247539a1dcbdea77dfc4d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.595354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a298a6db0c6247539a1dcbdea77dfc4d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.595929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.605631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a298a6db0c6247539a1dcbdea77dfc4d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.607031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5ccb-3d56-4dae-ae12-b23381945676 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.612925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.613559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.613842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.614175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.614892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:48.615197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.616040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a298a6db0c6247539a1dcbdea77dfc4d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.616921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.628404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a298a6db0c6247539a1dcbdea77dfc4d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:48.629633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 965/1926] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 20:59:48.633992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.635034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 962/1927] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:48 2022] DELETE /identity/v3/users/a298a6db0c6247539a1dcbdea77dfc4d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:48.635936 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:48.649948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b9365-5dbb-43b4-8c48-b49d3684157d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.728615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.729297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.734335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.734666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.735414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.737781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.785365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 966/1928] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:48 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:48.789858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.801582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef04451-6884-4137-b56c-4cfbcb0df0c2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.872427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.873181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.873459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.873729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.874591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.879078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.912807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 963/1929] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:48 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:48.914777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.927384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4443fb-8bc7-4837-9f79-892bb40548e6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.933070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.934346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.934635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.934916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.936394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.938201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.959122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 967/1930] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:48.963358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:48.974959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c8f4c-427b-4e99-8dc0-0165731ea7bb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:48.979724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:48.980423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:48.980678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:48.980984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:48.981653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:48.983862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:48.989738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:49.004620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.006907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:49.015986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 964/1931] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:49.021813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.053565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894601-eee4-4b9b-92c8-daab51d1d2a8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.054504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43455d-a494-4cc5-847d-0299028ac7bb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.061629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.062220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.062502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.062693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.062822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] PATH_INFO: `/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.063509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.063894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.064016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce43c492cc8a4e5a8849e9ea67ff457e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.064297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] PATH_INFO: `/v3/projects/b93c03491da8406990fe2b074910ff9d/users/d7f08dff2b3b40f09155db35d36a4865/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.066019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.086723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93c03491da8406990fe2b074910ff9d, user_id=d7f08dff2b3b40f09155db35d36a4865, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.089802 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c5183-4409-4931-be15-e67ceefe4954 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.113578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 965/1932] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:49 2022] PUT /identity/v3/projects/b93c03491da8406990fe2b074910ff9d/users/d7f08dff2b3b40f09155db35d36a4865/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:49.125290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d234f-d213-480e-b13c-625345885426 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.125814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d234f-d213-480e-b13c-625345885426 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.126333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d234f-d213-480e-b13c-625345885426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.172840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-093d234f-d213-480e-b13c-625345885426 None None] MFA Rules not processed for user `d7f08dff2b3b40f09155db35d36a4865`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:49.174421 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-093d234f-d213-480e-b13c-625345885426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:49.186474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:49.201704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce43c492cc8a4e5a8849e9ea67ff457e', 'request_id': 'req-7896beaf-dca2-49ef-a324-6277003e3673'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:49.213097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce43c492cc8a4e5a8849e9ea67ff457e', 'request_id': 'req-7896beaf-dca2-49ef-a324-6277003e3673'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:49.220592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce43c492cc8a4e5a8849e9ea67ff457e', 'request_id': 'req-7896beaf-dca2-49ef-a324-6277003e3673'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:49.234270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] The token cache is being invalidate because project ce43c492cc8a4e5a8849e9ea67ff457e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:49.234683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:49.235702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7896beaf-dca2-49ef-a324-6277003e3673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:49.237902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 968/1933] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:49 2022] DELETE /identity/v3/projects/ce43c492cc8a4e5a8849e9ea67ff457e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:49.242427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea3cb-aac5-47cc-9cf1-a201aae96a9c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.242729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea3cb-aac5-47cc-9cf1-a201aae96a9c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.243016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fea3cb-aac5-47cc-9cf1-a201aae96a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.256998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 966/1934] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:49.269568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d234f-d213-480e-b13c-625345885426 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.271212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-093d234f-d213-480e-b13c-625345885426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:49.271646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a7fea3cb-aac5-47cc-9cf1-a201aae96a9c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:49.273141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a7fea3cb-aac5-47cc-9cf1-a201aae96a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:49.336801 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d234f-d213-480e-b13c-625345885426 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.341168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.342331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.342618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.343652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.352984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.361524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 969/1935] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:49.361714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.363352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.363760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.364956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.365887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 967/1936] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 20:59:49.387110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:49.388671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:49.401165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 970/1937] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:49.402703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.417358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0821cce-1dda-49ef-9ec3-84b9132c0761 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.423584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.424707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.425294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.425705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.426792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:49.427496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.429655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.450020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 968/1938] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:49.457285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.462641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556828a-57b5-49c5-890d-ff3625d24cb5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.470508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.482859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.482859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.482859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.482859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.482859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.515779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 971/1939] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:49.519885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.534035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190572-e661-4d82-9f0a-b2487795b66f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.628307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:49.635506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.636279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.636637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.637479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.640174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.643237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.677543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 969/1940] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:49.682361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.694357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732945e-6477-4aff-9980-518959f887d4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.708778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.709958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.710333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.710637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.711397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.713217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.731275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 972/1941] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:49.733589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.751081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c2f4b-124c-476f-ab18-b973afd38443 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.756219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.756848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.757135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.757414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.758270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.760090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17037f4b-ef3c-427d-95aa-b8014540cd05 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.777957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 970/1942] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:49.784296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:49.800578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152791a-2aa8-466b-9bc2-e1b572b81582 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:49.814566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:49.815165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.815515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.816051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] PATH_INFO: `/v3/projects/5c9624303bf046dfbda844dda3f29c20/users/d1cc29ba63d44e1aa9408bd60cb53985/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.839256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9624303bf046dfbda844dda3f29c20, user_id=d1cc29ba63d44e1aa9408bd60cb53985, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:49.843008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:49.869030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 973/1943] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:49 2022] PUT /identity/v3/projects/5c9624303bf046dfbda844dda3f29c20/users/d1cc29ba63d44e1aa9408bd60cb53985/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:49.879905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:49.880194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:49.880472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:49.937237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] MFA Rules not processed for user `d1cc29ba63d44e1aa9408bd60cb53985`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:49.938890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:50.053665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 971/1944] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:50.058453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.132856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292152f0-10bf-49d8-80c1-1a5d0b04f1d5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.138946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.139439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.139724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.140033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.140706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.142643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.159075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:50.176583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 974/1945] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:50 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:50.181399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.204566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06a9f4-6e4f-4104-a84d-41e7b11720e9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.297236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.297955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.298217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.298675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.299413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.301415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.325451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 972/1946] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:50 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:50.330454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.341792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f957d-597c-486a-bf02-a16bf6f2bb8c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.347106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.347795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.348396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.348746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.349453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.351054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.362933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 975/1947] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:50.367067 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.378105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae679f7-5365-44a2-a7fe-d65c36c89768 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.382685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.383352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.383574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.383881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.384604 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.386331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1106b2f-8f47-48b7-8961-727df67e49bc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.396956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 973/1948] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:50.401176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.415528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf0be-a370-4245-8749-4500cae1cfd9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.420726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.421409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.421696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.421976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] PATH_INFO: `/v3/projects/7c6d9b10a4444a2f83bc449d2563b5d8/users/4f02892dd56042bbad17bcefe15e1773/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.437241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6d9b10a4444a2f83bc449d2563b5d8, user_id=4f02892dd56042bbad17bcefe15e1773, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.440048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.454268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 976/1949] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:50 2022] PUT /identity/v3/projects/7c6d9b10a4444a2f83bc449d2563b5d8/users/4f02892dd56042bbad17bcefe15e1773/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:50.465271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.465558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.465838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.494777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] MFA Rules not processed for user `4f02892dd56042bbad17bcefe15e1773`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:50.496038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:50.527195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:50.563265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 974/1950] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:50.567740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.629746 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c540f-e5a1-4239-8f27-9a60f199fbc4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.634491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.635063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.635339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.635619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.636346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.638354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.672105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 977/1951] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:50 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:50.676009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.688572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e283d-e60e-450f-bd6e-957690b1254d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.776508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.777195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.777515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.777795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.778536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.780876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.808963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 975/1952] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:50 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:50.813356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.824527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d1fac-adf9-47aa-9ac5-4bc330cc78c3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.829519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.830170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.830447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.830725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.831415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.833085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.848570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 978/1953] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:50.853109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.866445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994be2af-a236-44b0-9e74-0b546506b541 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:50.879141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:50.879890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:50.880179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:50.880467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] PATH_INFO: `/v3/projects/2c98d77c988147999effb55e84f4fbf2/users/0b43c135db2e4406a4b8b3ef412e2616/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:50.898292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c98d77c988147999effb55e84f4fbf2, user_id=0b43c135db2e4406a4b8b3ef412e2616, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:50.901159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:50.924430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 976/1954] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:50 2022] PUT /identity/v3/projects/2c98d77c988147999effb55e84f4fbf2/users/0b43c135db2e4406a4b8b3ef412e2616/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:50.928358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:50.941272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892c8e8-ea20-46c2-b682-48d36fde10ee admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:51.004328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:51.005026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:51.005434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:51.005769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:51.006609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:51.008626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f930d4-e024-4527-8768-cbf80a0a4af6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:51.020365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 979/1955] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:51.025268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:51.036634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49eceb-01ee-42a6-b8bc-d90ed729a6cd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:51.042198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:51.043085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:51.043386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:51.043868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] PATH_INFO: `/v3/projects/2c98d77c988147999effb55e84f4fbf2/users/0b43c135db2e4406a4b8b3ef412e2616/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:51.046243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c98d77c988147999effb55e84f4fbf2, user_id=0b43c135db2e4406a4b8b3ef412e2616, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:51.049202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:51.063544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 977/1956] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:51 2022] PUT /identity/v3/projects/2c98d77c988147999effb55e84f4fbf2/users/0b43c135db2e4406a4b8b3ef412e2616/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:51.073683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:51.073979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:51.074265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:51.115050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] MFA Rules not processed for user `0b43c135db2e4406a4b8b3ef412e2616`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:51.116759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:51.137032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:51.193147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 980/1957] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:51.205868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:51.207842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:51.267209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3893-c40c-4b5f-a32b-9ab2c8916af4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:51.271090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:51.272322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:51.272610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:51.272890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:51.282501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:51.283976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:51.294001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 978/1958] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:51.825196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:51.834637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8eb5-20a5-4549-bce8-c6dcd9dce400 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:51.838146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:51.838766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:51.839043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:51.839312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:51.898218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:51.899680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:51.909612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 981/1959] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:56.319957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:56.336856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816bca-8b0d-4869-be2c-bb5f2fa17087 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:56.345512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:56.346390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:56.351146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:56.351431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:56.404032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:56.458594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:56.460101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:56.497882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 979/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:56.788977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:56.791201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:56.875242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d973e-fd82-441b-99ab-a42a1541e754 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:56.880457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:56.881174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:56.881461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:56.881739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] PATH_INFO: `/v3/users/71add7accd2045d8868ee78a671327fd` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:56.883897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71add7accd2045d8868ee78a671327fd)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:56.886260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:56.939582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71add7accd2045d8868ee78a671327fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:56.940434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71add7accd2045d8868ee78a671327fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:56.947935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71add7accd2045d8868ee78a671327fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:56.954678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:56.960030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71add7accd2045d8868ee78a671327fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:56.960964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-14c0527f-1319-4700-a8a8-75ca641aa9e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71add7accd2045d8868ee78a671327fd'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:56.981486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 982/1961] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:56 2022] DELETE /identity/v3/users/71add7accd2045d8868ee78a671327fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:57.178891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.192243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f415b7-7e19-432d-8532-613a32bbb764 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.285845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.286503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.286912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.287193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] PATH_INFO: `/v3/projects/71e1ca214b6441efb2717b08466a6fb0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.288561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e1ca214b6441efb2717b08466a6fb0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.290710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.349563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e1ca214b6441efb2717b08466a6fb0', 'request_id': 'req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:57.360128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e1ca214b6441efb2717b08466a6fb0', 'request_id': 'req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:57.368805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e1ca214b6441efb2717b08466a6fb0', 'request_id': 'req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:57.384103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] The token cache is being invalidate because project 71e1ca214b6441efb2717b08466a6fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:57.384552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:57.386198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-dcf6727f-4d24-4b8b-b020-220f8fa2c27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:57.389363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 980/1962] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:57 2022] DELETE /identity/v3/projects/71e1ca214b6441efb2717b08466a6fb0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:57.394677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.395218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.395537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.427599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:57.428993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:57.494819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 983/1963] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:57.504008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.504284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.504566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.527575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:57.529526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:57.547277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 981/1964] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 20:59:57.551679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.563947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78c8dc-a559-4535-bb18-bbfd1823df7c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.569820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.570449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.570733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.571043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.571772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 20:59:57.572612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.573854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.587704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 984/1965] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 20:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 20:59:57.592707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.603516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76b6c8-17f0-4d5f-a1ef-823d322d7885 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.621148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.621148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.621148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.621148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.621601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.621601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.651778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 982/1966] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:57 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:57.656168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.666930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2124444-a347-460f-9849-adec5625ee62 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.737435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.738065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.738350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.738630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.739318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.741294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.763420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 985/1967] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:57 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 20:59:57.767626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.778965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45635c7-ab98-4429-970c-d49661555e50 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.783837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.784512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.784800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.785078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.786075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.787678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.801317 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 983/1968] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:57.805400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.816774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcd516-63e8-4835-b9a3-cbe14350e99e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.821466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.822089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.822374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.822653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.823354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.825002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d86f1-19b5-4066-9363-2fc03111c693 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.836088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 986/1969] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 20:59:57.840800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:57.853015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb4e-1cf0-4e10-8562-b359d6e16994 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:57.859428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:57.860154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.860562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.860769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] PATH_INFO: `/v3/projects/9d46bfc9163c4155b2e5ef6a613faecb/users/be486c7f671e4279ae5ce34f799f6354/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.885158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:57.890977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d46bfc9163c4155b2e5ef6a613faecb, user_id=be486c7f671e4279ae5ce34f799f6354, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:57.894449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:57.933638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 984/1970] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:57 2022] PUT /identity/v3/projects/9d46bfc9163c4155b2e5ef6a613faecb/users/be486c7f671e4279ae5ce34f799f6354/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:57.943817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:57.944299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:57.944741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:57.976357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] MFA Rules not processed for user `be486c7f671e4279ae5ce34f799f6354`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:57.977615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:58.007478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:58.046707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 987/1971] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:58.051176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.113943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f873751-acc8-4f01-8f9a-2835a9e85270 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.118578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.119194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.119475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.119778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.120443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.122414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.149304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 985/1972] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 20:59:58 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:58.153423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.164844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff4a4-d262-4be5-8696-d5bf5208d13d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.223300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.223888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.224176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.224453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.225129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.227087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.248321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 988/1973] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 20:59:58 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 20:59:58.252500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.263629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe6b7b-8877-4335-99a6-92a513c99b9b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.268589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.269213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.269498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.269776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.270474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.272141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.283874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 986/1974] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:58.288174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.298872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0185c16-a436-4de5-b485-f33e71960ffd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.303729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.304538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.304823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.305100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] PATH_INFO: `/v3/projects/e37ca66e9e864083b325efa259a976ef/users/b6fa0d70ea194f4b935ba23ca2751c92/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.320974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ca66e9e864083b325efa259a976ef, user_id=b6fa0d70ea194f4b935ba23ca2751c92, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.323854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.337077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 989/1975] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:58 2022] PUT /identity/v3/projects/e37ca66e9e864083b325efa259a976ef/users/b6fa0d70ea194f4b935ba23ca2751c92/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:58.341558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.351709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3d10-c1e7-439f-9f62-5ffa5a48f94f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.410822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.411448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.411728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.412058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.412756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.414349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080936-9a03-4e46-a198-c83cd4aec1d1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.425672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 987/1976] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 20:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 20:59:58.430072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.451736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3e169-c250-481c-9a5a-cd05c58477e3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.458958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.459543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.459864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.460267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] PATH_INFO: `/v3/projects/e37ca66e9e864083b325efa259a976ef/users/b6fa0d70ea194f4b935ba23ca2751c92/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.462379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ca66e9e864083b325efa259a976ef, user_id=b6fa0d70ea194f4b935ba23ca2751c92, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.465057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.476372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 990/1977] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 20:59:58 2022] PUT /identity/v3/projects/e37ca66e9e864083b325efa259a976ef/users/b6fa0d70ea194f4b935ba23ca2751c92/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:58.487283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.487709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.488017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.517512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] MFA Rules not processed for user `b6fa0d70ea194f4b935ba23ca2751c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:58.518709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:58.567605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:58.597122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 988/1978] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:58.604914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.607484 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:58.674511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b661-831e-45d9-be4d-911bc4cd2e3b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.678964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.679680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.680038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.680271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.693237 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.695081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.705744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 991/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:58.832959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.843455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e055f-2d8d-47ae-9fae-186674276db6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.847407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.848236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.848506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.848781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.889685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:58.891098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:58.913227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.914820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808eebd3-9ffc-4e62-ac3c-191ae1019b84 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:58.923624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:58.925662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 989/1980] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:58.967589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13193bae-b03c-482c-980a-7d0ddbd84ec1 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:58.972370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:58.973537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:58.973834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:58.974105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] PATH_INFO: `/v3/users/d1cc29ba63d44e1aa9408bd60cb53985` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:58.975311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cc29ba63d44e1aa9408bd60cb53985)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:58.977310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:59.031269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cc29ba63d44e1aa9408bd60cb53985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.032120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cc29ba63d44e1aa9408bd60cb53985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.041158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cc29ba63d44e1aa9408bd60cb53985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.054385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cc29ba63d44e1aa9408bd60cb53985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.056645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cc29ba63d44e1aa9408bd60cb53985'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.084843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 992/1981] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:58 2022] DELETE /identity/v3/users/d1cc29ba63d44e1aa9408bd60cb53985 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 20:59:59.094221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:59.094541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:59.094820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:59.117809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 20:59:59.119011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:59.190906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 990/1982] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 20:59:59.201365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:59.203476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:59.270214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5542b3-7a3e-46db-ad3e-c81f388771a3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:59.273864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:59.274483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:59.274768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:59.275047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:59.284901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:59.286856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:59.297388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 993/1983] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 20:59:59.569861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:59.571551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 20:59:59.587096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed34be-fa82-4a47-99fa-01dc94db952a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:59.593956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:59.594541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:59.594825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:59.595104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] PATH_INFO: `/v3/projects/5c9624303bf046dfbda844dda3f29c20` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:59.596315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9624303bf046dfbda844dda3f29c20)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:59.598227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:59.645836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9624303bf046dfbda844dda3f29c20', 'request_id': 'req-490f9da4-5210-4f00-9abc-e3c61db1fe73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.653288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9624303bf046dfbda844dda3f29c20', 'request_id': 'req-490f9da4-5210-4f00-9abc-e3c61db1fe73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.658838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9624303bf046dfbda844dda3f29c20', 'request_id': 'req-490f9da4-5210-4f00-9abc-e3c61db1fe73'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.670511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] The token cache is being invalidate because project 5c9624303bf046dfbda844dda3f29c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 20:59:59.670797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.671416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.673430 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 991/1984] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 20:59:59 2022] DELETE /identity/v3/projects/5c9624303bf046dfbda844dda3f29c20 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 20:59:59.677471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 20:59:59.687543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d31780-b190-4270-a776-b7d1ea5c1acb service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 20:59:59.732321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 20:59:59.746494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 20:59:59.747889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 20:59:59.748059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 20:59:59.748333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] PATH_INFO: `/v3/users/4f02892dd56042bbad17bcefe15e1773` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 20:59:59.749496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f02892dd56042bbad17bcefe15e1773)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 20:59:59.751427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 20:59:59.796511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f02892dd56042bbad17bcefe15e1773'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.797172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f02892dd56042bbad17bcefe15e1773'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.804841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f02892dd56042bbad17bcefe15e1773'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.814376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f02892dd56042bbad17bcefe15e1773'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.814994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f02892dd56042bbad17bcefe15e1773'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 20:59:59.833350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 994/1985] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 20:59:59 2022] DELETE /identity/v3/users/4f02892dd56042bbad17bcefe15e1773 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:00.121974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:00.124010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:00.146776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f9da4-5210-4f00-9abc-e3c61db1fe73 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:00.152616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:00.221261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:00.221261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:00.221261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:00.221261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] PATH_INFO: `/v3/projects/7c6d9b10a4444a2f83bc449d2563b5d8` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:00.224917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6d9b10a4444a2f83bc449d2563b5d8)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:00.227105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:00.289473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6d9b10a4444a2f83bc449d2563b5d8', 'request_id': 'req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.298085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6d9b10a4444a2f83bc449d2563b5d8', 'request_id': 'req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.305699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6d9b10a4444a2f83bc449d2563b5d8', 'request_id': 'req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.318136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] The token cache is being invalidate because project 7c6d9b10a4444a2f83bc449d2563b5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:00.318603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.319271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.320983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 992/1986] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:00 2022] DELETE /identity/v3/projects/7c6d9b10a4444a2f83bc449d2563b5d8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:00.326059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:00.327856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:00.344015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916853e-1e2a-471d-8717-639589220200 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:00.421185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:00.421999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:00.422436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:00.422855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] PATH_INFO: `/v3/users/0b43c135db2e4406a4b8b3ef412e2616` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:00.424225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b43c135db2e4406a4b8b3ef412e2616)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:00.426605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:00.504154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b43c135db2e4406a4b8b3ef412e2616'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.504923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b43c135db2e4406a4b8b3ef412e2616'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.514018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b43c135db2e4406a4b8b3ef412e2616'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.524421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b43c135db2e4406a4b8b3ef412e2616'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.525062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0af70789-f276-4aa9-b4fb-e5637a37a1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b43c135db2e4406a4b8b3ef412e2616'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.530755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:00.550034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 995/1987] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:00 2022] DELETE /identity/v3/users/0b43c135db2e4406a4b8b3ef412e2616 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:00.837550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:00.839060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:00.859381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8efcd0-6a5c-4e18-af2c-38081ae176e3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:00.923993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:00.924642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:00.924924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:00.925201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] PATH_INFO: `/v3/projects/2c98d77c988147999effb55e84f4fbf2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:00.926370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c98d77c988147999effb55e84f4fbf2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:00.928322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:00.969458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:00.976233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c98d77c988147999effb55e84f4fbf2', 'request_id': 'req-9714f956-c7f7-475b-a516-35e8819432ac'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.984418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c98d77c988147999effb55e84f4fbf2', 'request_id': 'req-9714f956-c7f7-475b-a516-35e8819432ac'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:00.991002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c98d77c988147999effb55e84f4fbf2', 'request_id': 'req-9714f956-c7f7-475b-a516-35e8819432ac'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.002086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] The token cache is being invalidate because project 2c98d77c988147999effb55e84f4fbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:01.002372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.003004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9714f956-c7f7-475b-a516-35e8819432ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.004559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 993/1988] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:00 2022] DELETE /identity/v3/projects/2c98d77c988147999effb55e84f4fbf2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:01.010418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.010709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.010989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.032494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:01.033679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.095046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 996/1989] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:01.103840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.104133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.104416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.125484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:01.126702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.134673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 994/1990] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:01.139513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.149275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd9bb-ab71-4efc-8266-ffa4abd014f8 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.154430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.155051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.155335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.155620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.156380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:01.156691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.158318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.172579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 997/1991] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:00:01.175133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.184539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feac39-da58-4934-872b-bd94ef41eaca None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.189924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.190612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.190950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.191258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.191978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.193898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.223280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 995/1992] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:01.227406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.237295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eeeb0-4f58-4b44-8ad8-c69153f76824 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.294368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.294987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.295282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.295559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.296268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.298216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.320213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 998/1993] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:01.324316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.334933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ec214-2a28-404b-aa17-8a95a6b41ca9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.339472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.340110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.340390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.340663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.342007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.343593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.354290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 996/1994] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:01.358215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.368354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7b370-b751-4220-b44a-fb02d94bd235 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.374114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.374772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.375076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.375348 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.376086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.377675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b1f3c-74d9-404a-a4b7-16198475cbfc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.390379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 999/1995] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:01.394621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.404915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1997-c6cd-41d3-801c-ed0989b8ff9a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.409829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.410738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.411018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.411295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] PATH_INFO: `/v3/projects/548e33a639ae4d2b84f5fd4fa06f37b0/users/078b33a2d9764977b2e033a1e98fcec4/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.425567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548e33a639ae4d2b84f5fd4fa06f37b0, user_id=078b33a2d9764977b2e033a1e98fcec4, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.428238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.440978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 997/1996] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:01 2022] PUT /identity/v3/projects/548e33a639ae4d2b84f5fd4fa06f37b0/users/078b33a2d9764977b2e033a1e98fcec4/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:01.455044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.455486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.455967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.485770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] MFA Rules not processed for user `078b33a2d9764977b2e033a1e98fcec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:01.486986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.529719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:01.561321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1000/1997] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:01.565876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.637129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91b62-e5eb-462c-acb9-05e6eaab1668 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.644353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.644984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.645268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.645544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.646465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.648295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.665761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.669130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.688482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 998/1998] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:01.689813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.693443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1597fe-7d86-47b2-ad8c-aace1eb26a1c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.751397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:01.765938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b284d-fda1-4625-abd5-c159e5d58847 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.768552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.769224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.769512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.769809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] PATH_INFO: `/v3/users/d7f08dff2b3b40f09155db35d36a4865` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.771134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f08dff2b3b40f09155db35d36a4865)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.771889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.772631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.772935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.773179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.773282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.773840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.775911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.803072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 999/1999] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:01.807447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.819035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9baf2-4681-41de-8099-5758d5932780 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.824250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.824870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.825181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.825506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.826327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.828211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.830963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f08dff2b3b40f09155db35d36a4865'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.831671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f08dff2b3b40f09155db35d36a4865'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.838836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f08dff2b3b40f09155db35d36a4865'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.839997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1000/2000] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:01.844674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.848428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.848797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f08dff2b3b40f09155db35d36a4865'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.849642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ee614ab-2218-41e0-93fe-46da9cc799b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f08dff2b3b40f09155db35d36a4865'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:01.863711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607b93c-2065-4642-a932-1527dec192a1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.868649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.869323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.869602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.869871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] PATH_INFO: `/v3/projects/12962d2f73a4405983d6ecaf8336096a/users/d87ac350579b48d1a353a0c3dc9b7e6a/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.874007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1001/2001] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:01 2022] DELETE /identity/v3/users/d7f08dff2b3b40f09155db35d36a4865 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:01.878040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.878333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.878649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.886928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12962d2f73a4405983d6ecaf8336096a, user_id=d87ac350579b48d1a353a0c3dc9b7e6a, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.890484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:01.904502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:01.905714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:01.906808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1001/2002] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:01 2022] PUT /identity/v3/projects/12962d2f73a4405983d6ecaf8336096a/users/d87ac350579b48d1a353a0c3dc9b7e6a/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:01.911240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.974349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:01.989860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f660d-b872-4836-a753-dffa0d4e6cd3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:01.991558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1002/2003] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:01.995015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:01.995642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:01.995954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:01.996232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:01.996978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:01.998540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:01.998786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.000319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.009567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1002/2004] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:02.014494 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.024431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434dd8-697c-4eef-969c-1e03caba42d4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.029903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.030562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.030846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.031248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] PATH_INFO: `/v3/projects/12962d2f73a4405983d6ecaf8336096a/users/d87ac350579b48d1a353a0c3dc9b7e6a/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.033255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12962d2f73a4405983d6ecaf8336096a, user_id=d87ac350579b48d1a353a0c3dc9b7e6a, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.036192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9612c-baf9-4f6c-9467-1c60ee46a09a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.046975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1003/2005] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:02 2022] PUT /identity/v3/projects/12962d2f73a4405983d6ecaf8336096a/users/d87ac350579b48d1a353a0c3dc9b7e6a/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:02.057734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.058129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.058478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.072510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b8aeb-65bb-4816-b72d-5154afb411fa None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.087062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] MFA Rules not processed for user `d87ac350579b48d1a353a0c3dc9b7e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:02.088336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.131601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.132637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.132637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.132850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.164496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1004/2006] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:02.176525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.178071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.199225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:02.200926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.203556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.218506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1003/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:02.253392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a410f2-e45f-4e3c-85ce-c42708088a4f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.257078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.257708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.257994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.258273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.260151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.323874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.325327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76368001-628f-4811-8091-c26597cc82fe service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.334568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1005/2008] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:02.593783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.595601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.626552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f80ca-776f-459a-84a3-d6db2641113f service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.632771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.634181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.634716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.635074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] PATH_INFO: `/v3/projects/b93c03491da8406990fe2b074910ff9d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.636605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93c03491da8406990fe2b074910ff9d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.638943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.693941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93c03491da8406990fe2b074910ff9d', 'request_id': 'req-2294b012-e250-4314-91a9-7a830c58cbe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:02.701851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93c03491da8406990fe2b074910ff9d', 'request_id': 'req-2294b012-e250-4314-91a9-7a830c58cbe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:02.706136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:02.708683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93c03491da8406990fe2b074910ff9d', 'request_id': 'req-2294b012-e250-4314-91a9-7a830c58cbe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:02.722210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] The token cache is being invalidate because project b93c03491da8406990fe2b074910ff9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:02.722500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:02.723147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2294b012-e250-4314-91a9-7a830c58cbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:02.724710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1004/2009] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:02 2022] DELETE /identity/v3/projects/b93c03491da8406990fe2b074910ff9d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:02.729699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.730014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.730304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.750454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:02.751649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.811303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1006/2010] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:02.819251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.819543 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.819871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.840000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:02.842693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:02.849714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1005/2011] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:02.854060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.864513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af39f74-5fbe-4343-ad3e-8b6f9fe460a1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.869141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.869749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.870032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.870305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.871030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:02.871337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.872992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.884461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1007/2012] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:02.889223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.898683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705e279-28ae-4e2a-b838-6a9229ddb44e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:02.904288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:02.904904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:02.905183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:02.905453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:02.906236 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:02.908377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:02.947398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1006/2013] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:02 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:02.951908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:02.962327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6331-c0d1-4060-ac06-792e1c8a6ffe admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:03.022938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:03.029910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:03.031082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.031505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.031940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.032622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:03.034568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:03.058807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1008/2014] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:02 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:03.064005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:03.074511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81077f-6d70-48a7-996a-b167dfb1b15f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:03.079480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:03.080179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.080475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.080738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.081443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:03.084002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:03.095260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1007/2015] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:03.099521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:03.111235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59645-ed5f-4088-9c9c-7ac18d307606 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:03.120372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:03.121122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.121502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.121926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.122891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:03.124843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb82e96-67d5-4ae8-918a-d40465537891 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:03.136712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1009/2016] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:03.142514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:03.155610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122a29b-2a10-4424-a3fd-93037d38b1fb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:03.160780 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:03.161463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.161827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.162168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] PATH_INFO: `/v3/projects/be8ce1d6e4d9416a8061c18945775199/users/074eddadf1f84c848948aea7f1a3785e/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.182762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8ce1d6e4d9416a8061c18945775199, user_id=074eddadf1f84c848948aea7f1a3785e, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:03.185999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:03.204960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1008/2017] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:03 2022] PUT /identity/v3/projects/be8ce1d6e4d9416a8061c18945775199/users/074eddadf1f84c848948aea7f1a3785e/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:03.216526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.216843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.217106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.249330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] MFA Rules not processed for user `074eddadf1f84c848948aea7f1a3785e`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:03.250545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:03.329274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1010/2018] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:03.353929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:03.356907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:03.429055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab333f8-fd60-4a78-aefb-4aadf62f9184 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:03.434907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:03.435866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:03.436384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:03.436689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:03.449217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:03.453297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283d06-a130-4763-8401-e8d423a08bba service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:03.463141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1009/2019] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:04.937028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:04.938670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:05.029822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49b578-31a8-48e8-8b8b-fecd1d3004f3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:05.036361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:05.037200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:05.037582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:05.038020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] PATH_INFO: `/v3/users/078b33a2d9764977b2e033a1e98fcec4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:05.039230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=078b33a2d9764977b2e033a1e98fcec4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:05.041398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:05.091950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078b33a2d9764977b2e033a1e98fcec4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.092610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078b33a2d9764977b2e033a1e98fcec4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.100718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078b33a2d9764977b2e033a1e98fcec4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.113355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078b33a2d9764977b2e033a1e98fcec4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.115427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:05.128673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078b33a2d9764977b2e033a1e98fcec4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.134702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1011/2020] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:04 2022] DELETE /identity/v3/users/078b33a2d9764977b2e033a1e98fcec4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:05.139501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:05.140033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:05.140124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:05.161027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:05.162303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:05.240464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1010/2021] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:05.252676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:05.254103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:05.317359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b41e1-bc1c-4242-963a-1bf9664b6e7f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:05.321027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:05.321655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:05.321938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:05.322213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:05.331405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:05.332880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:05.343933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1012/2022] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:05.634917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:05.636418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:05.650758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68280d34-9bfd-4973-9234-b42c28a9dd06 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:05.661415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:05.662579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:05.662872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:05.663155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] PATH_INFO: `/v3/projects/548e33a639ae4d2b84f5fd4fa06f37b0` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:05.664812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=548e33a639ae4d2b84f5fd4fa06f37b0)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:05.667207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:05.702162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:05.726933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548e33a639ae4d2b84f5fd4fa06f37b0', 'request_id': 'req-f7452fc4-b287-4894-a968-757c85e30b8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.735833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548e33a639ae4d2b84f5fd4fa06f37b0', 'request_id': 'req-f7452fc4-b287-4894-a968-757c85e30b8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.742072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548e33a639ae4d2b84f5fd4fa06f37b0', 'request_id': 'req-f7452fc4-b287-4894-a968-757c85e30b8b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.754287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] The token cache is being invalidate because project 548e33a639ae4d2b84f5fd4fa06f37b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:05.754803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.755631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.757359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1011/2023] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:05 2022] DELETE /identity/v3/projects/548e33a639ae4d2b84f5fd4fa06f37b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:05.761458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:05.771373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8e660-c8da-4d27-a2bb-d2958398135c service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:05.837625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:05.838308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:05.838593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:05.838872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] PATH_INFO: `/v3/users/d87ac350579b48d1a353a0c3dc9b7e6a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:05.840088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87ac350579b48d1a353a0c3dc9b7e6a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:05.842635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:05.957778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87ac350579b48d1a353a0c3dc9b7e6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.958771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87ac350579b48d1a353a0c3dc9b7e6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.974923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87ac350579b48d1a353a0c3dc9b7e6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:05.987514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87ac350579b48d1a353a0c3dc9b7e6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.018428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9bc95829-0b13-47ad-b4ef-8a2402230ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87ac350579b48d1a353a0c3dc9b7e6a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.025979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1013/2024] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:05 2022] DELETE /identity/v3/users/d87ac350579b48d1a353a0c3dc9b7e6a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:06.089577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.091612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.104501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7452fc4-b287-4894-a968-757c85e30b8b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.164773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.165482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.165696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.166101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] PATH_INFO: `/v3/users/be486c7f671e4279ae5ce34f799f6354` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.167293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be486c7f671e4279ae5ce34f799f6354)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.169858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.226681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be486c7f671e4279ae5ce34f799f6354'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.227980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be486c7f671e4279ae5ce34f799f6354'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.235715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be486c7f671e4279ae5ce34f799f6354'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.244742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be486c7f671e4279ae5ce34f799f6354'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.244877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be486c7f671e4279ae5ce34f799f6354'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.264688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1012/2025] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:06 2022] DELETE /identity/v3/users/be486c7f671e4279ae5ce34f799f6354 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:06.269627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.269893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.270177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.280869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:06.294520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:06.296209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.323856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.325898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.361175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1014/2026] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:06.370907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.372343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.379253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:06.418598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f4983-2540-43fc-ade3-91331be9b8e6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.423400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.424080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.424363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.424646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] PATH_INFO: `/v3/projects/12962d2f73a4405983d6ecaf8336096a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.425835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12962d2f73a4405983d6ecaf8336096a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.427766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.438414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2f57-891f-4e6a-b48c-5fd47c9a8583 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.442055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.442698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.442978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.443252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.452936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.454483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564513b6-49c5-4a55-9b37-e322c309c0ae service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.467182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1015/2027] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:06.482026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12962d2f73a4405983d6ecaf8336096a', 'request_id': 'req-8f32d14b-c73f-40e6-af51-e1734a8b1617'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.489506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12962d2f73a4405983d6ecaf8336096a', 'request_id': 'req-8f32d14b-c73f-40e6-af51-e1734a8b1617'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.495798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12962d2f73a4405983d6ecaf8336096a', 'request_id': 'req-8f32d14b-c73f-40e6-af51-e1734a8b1617'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.508030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] The token cache is being invalidate because project 12962d2f73a4405983d6ecaf8336096a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:06.508393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.509121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.510744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1013/2028] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:06 2022] DELETE /identity/v3/projects/12962d2f73a4405983d6ecaf8336096a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:06.516498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c434-ccae-4664-8fe5-66ee56869474 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.517099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c434-ccae-4664-8fe5-66ee56869474 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.517391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c434-ccae-4664-8fe5-66ee56869474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.538689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0c84c434-ccae-4664-8fe5-66ee56869474 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:06.539931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0c84c434-ccae-4664-8fe5-66ee56869474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.567508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.568899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.611570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1016/2029] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:06.626043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.626231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.626625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.647349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32d14b-c73f-40e6-af51-e1734a8b1617 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.652679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.652836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:06.653773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.654032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.654164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.654481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] PATH_INFO: `/v3/users/074eddadf1f84c848948aea7f1a3785e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.656279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074eddadf1f84c848948aea7f1a3785e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.658035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.666602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1017/2030] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:06.667967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.677807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ea457-4a81-41db-a076-f2871e005dd8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.683577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.685667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.685667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.685667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.686311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:06.686687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.689056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.703727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1018/2031] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:06.708741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.719023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76b74-863e-4385-8b0f-5950a6d5e79b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.724131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.724763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.725050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.725360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.726044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.728486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.777580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1019/2032] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:06.778978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.781144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.781377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074eddadf1f84c848948aea7f1a3785e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.782213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074eddadf1f84c848948aea7f1a3785e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.792860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:06.793824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074eddadf1f84c848948aea7f1a3785e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.805793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074eddadf1f84c848948aea7f1a3785e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.806580 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074eddadf1f84c848948aea7f1a3785e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.808374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:06.834655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1014/2033] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:06 2022] DELETE /identity/v3/users/074eddadf1f84c848948aea7f1a3785e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:06.834655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.834655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.854857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0b3f1-f02e-4f7e-838b-65eaba3a8c49 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.899912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230691-2c5d-48d6-8fc8-8176f9740948 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:06.905667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.906582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.906874 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.907154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.908175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.911221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3a306-f937-4cfc-9d0f-533d797b918f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.911737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:06.912404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.912685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.912961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] PATH_INFO: `/v3/projects/9d46bfc9163c4155b2e5ef6a613faecb` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.914630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d46bfc9163c4155b2e5ef6a613faecb)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:06.916709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:06.937878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1015/2034] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:06.937878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:06.937878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:06.937878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:06.956336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:06.957536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:06.964663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d46bfc9163c4155b2e5ef6a613faecb', 'request_id': 'req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.972462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d46bfc9163c4155b2e5ef6a613faecb', 'request_id': 'req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.978891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d46bfc9163c4155b2e5ef6a613faecb', 'request_id': 'req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.991135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] The token cache is being invalidate because project 9d46bfc9163c4155b2e5ef6a613faecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:06.991431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.992099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:06.993741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1020/2035] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:06 2022] DELETE /identity/v3/projects/9d46bfc9163c4155b2e5ef6a613faecb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:06.994592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:06.995971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.021201 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1016/2036] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:07.022364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.026772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.042489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876459-922b-4122-aa62-ec9e821b42d1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.049132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:07.052341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.053143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.053757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.054060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] PATH_INFO: `/v3/users/b6fa0d70ea194f4b935ba23ca2751c92` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.055448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fa0d70ea194f4b935ba23ca2751c92)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.057852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.080128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9fec6-e051-4ea4-9ad7-b8c9f79fa689 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.085460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.088279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.088595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.088880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.092432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.094076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.117088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1021/2037] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:07.117847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.119898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.134942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fa0d70ea194f4b935ba23ca2751c92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.135625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fa0d70ea194f4b935ba23ca2751c92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.145041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fa0d70ea194f4b935ba23ca2751c92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.154847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fa0d70ea194f4b935ba23ca2751c92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.155807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fa0d70ea194f4b935ba23ca2751c92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.158124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:07.183803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1017/2038] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:07 2022] DELETE /identity/v3/users/b6fa0d70ea194f4b935ba23ca2751c92 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:07.188731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.193776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.209183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f7e6-914a-4b17-9bd2-09864c5532bc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.286411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.287587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.288076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.288581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.292212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.302791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aec1c2-f59f-46d9-bf20-546381ebadcd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.307429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.310369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.311184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.311448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.311723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.312615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.313189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfcc81-79f9-4067-b725-319d412210b2 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.315668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.326961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1022/2039] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:07.329361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1018/2040] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:07.333409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.344474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dc857-0b22-408d-8173-eb0eefd17684 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.350238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.351324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.352069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.352358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] PATH_INFO: `/v3/projects/5429201dc1ba48759494887f5517efe2/users/0ccb07fb0a114ffda2f3a4767225a638/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.375389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5429201dc1ba48759494887f5517efe2, user_id=0ccb07fb0a114ffda2f3a4767225a638, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.378107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.407786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1019/2041] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:07 2022] PUT /identity/v3/projects/5429201dc1ba48759494887f5517efe2/users/0ccb07fb0a114ffda2f3a4767225a638/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:07.426951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.427241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.427553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.472939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] MFA Rules not processed for user `0ccb07fb0a114ffda2f3a4767225a638`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:07.475023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.582814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1023/2042] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:07.595623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.597560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.636082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.637507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.669651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65c7dc-495f-44a6-9e35-29f0aba3604e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.674087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.675017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.675286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.675571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.685326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:07.690637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.692685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.706565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1020/2043] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:07.735981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:07.736898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.739580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395eca2-d3d7-4969-b8d9-5673fee97b16 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.745541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.747008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.747810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.748631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] PATH_INFO: `/v3/projects/e37ca66e9e864083b325efa259a976ef` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.750434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37ca66e9e864083b325efa259a976ef)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.752937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.756359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c180d5-a13b-46c5-9472-a3b2846189c6 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:07.760853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:07.762131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.763061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.763307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] PATH_INFO: `/v3/projects/be8ce1d6e4d9416a8061c18945775199` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.765077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8ce1d6e4d9416a8061c18945775199)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:07.767260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:07.814856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37ca66e9e864083b325efa259a976ef', 'request_id': 'req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.824128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8ce1d6e4d9416a8061c18945775199', 'request_id': 'req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.825355 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37ca66e9e864083b325efa259a976ef', 'request_id': 'req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.829245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:07.832514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37ca66e9e864083b325efa259a976ef', 'request_id': 'req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.836725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8ce1d6e4d9416a8061c18945775199', 'request_id': 'req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.845849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8ce1d6e4d9416a8061c18945775199', 'request_id': 'req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.847461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] The token cache is being invalidate because project e37ca66e9e864083b325efa259a976ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:07.847891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.848769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-36098fe4-aeb0-4eb1-ae13-537cfbcfd92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.850908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1024/2044] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:07 2022] DELETE /identity/v3/projects/e37ca66e9e864083b325efa259a976ef => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:07.855809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc59e4d-6b4e-4bc4-be58-82920e13373c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.856129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc59e4d-6b4e-4bc4-be58-82920e13373c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.856469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc59e4d-6b4e-4bc4-be58-82920e13373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.862275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] The token cache is being invalidate because project be8ce1d6e4d9416a8061c18945775199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:07.862721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.863381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-b059cd31-7c3c-4b7c-8ea2-77fabf76fb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:07.867134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1021/2045] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:07 2022] DELETE /identity/v3/projects/be8ce1d6e4d9416a8061c18945775199 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:07.872428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a18ed-cc4a-4fc6-8425-7febecc7bce0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.872832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a18ed-cc4a-4fc6-8425-7febecc7bce0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.873253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a18ed-cc4a-4fc6-8425-7febecc7bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.878224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cbc59e4d-6b4e-4bc4-be58-82920e13373c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:07.879448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cbc59e4d-6b4e-4bc4-be58-82920e13373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.897311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-403a18ed-cc4a-4fc6-8425-7febecc7bce0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:07.898654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-403a18ed-cc4a-4fc6-8425-7febecc7bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:07.969906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1025/2046] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:07.971941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1022/2047] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:07.987349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.987349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.987349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:07.988781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:07.989074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:07.989354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.010841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:08.013175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.013643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:08.015477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.023491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1026/2048] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:08.028671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.031994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1023/2049] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:08.031994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.040094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83893a4-3c76-4253-b240-a1d25509b841 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.041360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f847-a7c0-4263-9d7c-475d21ea2f10 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.046103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.046829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.046928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.047114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.047539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.047645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.048020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.048369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.048476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:08.048707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.049212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:08.049616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.050312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.051347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.063580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1027/2050] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:08.070431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.070898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1024/2051] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:00:08.071292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.081017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f98fd-b641-4aa1-a424-47be05996126 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.082151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb188f3-ad5e-4338-81b6-102d35f6c134 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.085807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.086422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.086705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.086892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.087005 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.087505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.087626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.087852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.088235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.089023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.089630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.092652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.120378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1028/2052] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.124104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1025/2053] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.125028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.128374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.144892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:08.192250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735ee05-bb53-4677-b2b5-10b01b011ef5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.193934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e51c6-36a9-4f3d-bb5f-3823f79f8f9b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.197013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.197638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.197929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.198215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.198636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.198904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.199251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.199532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.199939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.200852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.200959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.203106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.223320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1029/2054] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.226434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1026/2055] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.227830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.230113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.239121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5e3ff-e806-491b-8876-6d69170f7141 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.240363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a513-c7a0-428d-9b46-f5c862fd8dfd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.245191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.245327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.245810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.245915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.246089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.246205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.246384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.246488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.247138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.247391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.248821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.249215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.259175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1030/2056] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:08.263223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.266350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1027/2057] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:08.267309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.274529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417996c-ecf1-438d-ae6a-4db10fbd105e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.278933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee00276-5f5e-4a8b-8d62-d60f1a26ecf4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.279980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.280588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.280878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.281152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.281852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.284101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.290574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.291418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.291902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.292299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.293034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.295257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.299821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1031/2058] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:08.302189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.307231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1028/2059] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:08.311558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.313190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bef72-f8bc-46ff-87b8-006a859b32ab admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.319420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.320148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.321090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.321090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] PATH_INFO: `/v3/projects/299a4b041f7b44f0bbc1b62ed40cfcab/users/84b591b5e75f49d0a724c2419636d4c5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.323598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502cdeb-1c3d-43a7-b354-c6513f6eca09 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.329125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.329816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.330082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.330353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] PATH_INFO: `/v3/projects/d6de5bfc905443f683f35ae85e513b9c/users/90af973cde7c44f682f5a873d5ca959d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.333077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:08.339001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299a4b041f7b44f0bbc1b62ed40cfcab, user_id=84b591b5e75f49d0a724c2419636d4c5, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.342705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d30e6-e944-4b4a-88e9-eb434e6d29c3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.354359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6de5bfc905443f683f35ae85e513b9c, user_id=90af973cde7c44f682f5a873d5ca959d, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.366119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1032/2060] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:08 2022] PUT /identity/v3/projects/299a4b041f7b44f0bbc1b62ed40cfcab/users/84b591b5e75f49d0a724c2419636d4c5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:08.366307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f54e0-a022-40a3-a599-a9210d19bd31 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.368640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.369069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.369547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.378456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1029/2061] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:08 2022] PUT /identity/v3/projects/d6de5bfc905443f683f35ae85e513b9c/users/90af973cde7c44f682f5a873d5ca959d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:08.391326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.391640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.392687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.402492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] MFA Rules not processed for user `84b591b5e75f49d0a724c2419636d4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:08.404480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.431190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] MFA Rules not processed for user `90af973cde7c44f682f5a873d5ca959d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:08.432428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.473561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1033/2062] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:08.477633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.509711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1030/2063] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:08.523434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.527731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.543439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:08.568271 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8a2f-dc4b-4e25-aa95-cc0bbe5d23f6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.573791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.574806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.575373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.575884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.576859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.579436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.609878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76747f-8f91-4ab7-a135-f8ed7ef87673 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.613529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1034/2064] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.614462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.615101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.615385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.615944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.617747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.627031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.630598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.642391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1031/2065] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:08.680136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.693140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ee0a-666b-40bb-b31c-dff69a0ed921 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.696828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b363-55f8-4b37-9e02-e2abbd8e3388 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.698511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.699215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.699561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.699914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] PATH_INFO: `/v3/users/90af973cde7c44f682f5a873d5ca959d` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.701273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90af973cde7c44f682f5a873d5ca959d)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.702889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.703396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.703589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.704022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.704454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.705225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.707382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.742544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1035/2066] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:08.745547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.762023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d5aa-a4cf-426d-9e74-31c620ba757f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.770927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.771546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.771851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.772128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.773060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.774662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.780154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90af973cde7c44f682f5a873d5ca959d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:08.781319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90af973cde7c44f682f5a873d5ca959d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:08.785865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1036/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:08.790103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.791961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.794262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90af973cde7c44f682f5a873d5ca959d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:08.804009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90af973cde7c44f682f5a873d5ca959d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:08.805020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57194551-3e27-4fa1-804d-4eed47e6e64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90af973cde7c44f682f5a873d5ca959d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:08.806981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f0e09-c36f-4fa2-8ea8-9f692093cb56 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.813157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.814069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.814467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.814628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:08.815092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] PATH_INFO: `/v3/projects/7058620dc2814df6b7f445003f799d93/users/b4d05905fb5841a3a462ef447548c2cc/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.835140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1032/2068] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:08 2022] DELETE /identity/v3/users/90af973cde7c44f682f5a873d5ca959d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:08.835533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7058620dc2814df6b7f445003f799d93, user_id=b4d05905fb5841a3a462ef447548c2cc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.839488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.839808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.840176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.841427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.859850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1037/2069] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:08 2022] PUT /identity/v3/projects/7058620dc2814df6b7f445003f799d93/users/b4d05905fb5841a3a462ef447548c2cc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:08.861782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.863355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:08.864692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.935668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e292e-2da4-44e7-908b-fdfe495d6d73 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.940590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.941214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.941491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.941835 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.942532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.944211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.944689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1033/2070] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:08.955562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.956962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:08.960500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1038/2071] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:08.961560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:08.973364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d24a0-d17b-4ac9-8c31-8c6fc9660a89 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:08.978122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:08.978791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:08.979081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:08.979357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] PATH_INFO: `/v3/projects/7058620dc2814df6b7f445003f799d93/users/b4d05905fb5841a3a462ef447548c2cc/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:08.981983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7058620dc2814df6b7f445003f799d93, user_id=b4d05905fb5841a3a462ef447548c2cc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:08.984670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035abcf9-00c9-4940-84e7-cbeb90d1d2da admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:08.995340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1039/2072] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:08 2022] PUT /identity/v3/projects/7058620dc2814df6b7f445003f799d93/users/b4d05905fb5841a3a462ef447548c2cc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:09.006565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.006857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.007130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.019213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808794-97ed-4c2b-8c0c-1d28a7a11f46 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.033203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:09.036527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] MFA Rules not processed for user `b4d05905fb5841a3a462ef447548c2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:09.039094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.073256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.074139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.074789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.075273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.140474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1040/2073] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:09.151598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.154463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.162909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:09.173480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.175405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.188718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1034/2074] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:09.224432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d278fb-456b-40df-8fa9-b8be21a224a5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.228161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.228792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.229078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.229357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.240898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.242428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eb0f8-18d0-4e11-b63b-e68cbf6ca143 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.258956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1041/2075] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:09.505100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.506757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.529623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1edb-3620-4f23-aa74-581b3c04b8b9 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.534877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.535853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.536174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.536462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] PATH_INFO: `/v3/projects/d6de5bfc905443f683f35ae85e513b9c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.537730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6de5bfc905443f683f35ae85e513b9c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.539655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.599845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6de5bfc905443f683f35ae85e513b9c', 'request_id': 'req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.612513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6de5bfc905443f683f35ae85e513b9c', 'request_id': 'req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.621008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6de5bfc905443f683f35ae85e513b9c', 'request_id': 'req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.633633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] The token cache is being invalidate because project d6de5bfc905443f683f35ae85e513b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:09.633891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.634556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b2400c8-9a9b-4161-ba5b-6fe10e9d4140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.636168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1035/2076] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:09 2022] DELETE /identity/v3/projects/d6de5bfc905443f683f35ae85e513b9c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:09.640922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.641469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.641819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.667356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:09.669178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.732777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1042/2077] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:09.740395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.740688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.740996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.762845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:09.764137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.772601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1036/2078] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:09.777068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.788273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262b31a-cddb-4130-be7d-9cb413f66794 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.789594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.791102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.794769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.795397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.795899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.796117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.796753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:09.798209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.798661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.805565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3cec7-2701-4934-af0e-402e9b3062ad None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.813831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.814481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.814758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.815037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] PATH_INFO: `/v3/users/84b591b5e75f49d0a724c2419636d4c5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.816251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b591b5e75f49d0a724c2419636d4c5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.817752 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1043/2079] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:00:09.818155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.822824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.836486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00058-5a52-4b0f-8bf9-c89dc95981fd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:09.841528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:09.842351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.842719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.843019 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.843737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:09.845872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:09.875239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b591b5e75f49d0a724c2419636d4c5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.875999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b591b5e75f49d0a724c2419636d4c5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.882134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1044/2080] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:09.886029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:09.888401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.891207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b591b5e75f49d0a724c2419636d4c5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.899406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:09.900449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b591b5e75f49d0a724c2419636d4c5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.901166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d25fba9b-aaa8-4bef-a3d1-963703a2d891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b591b5e75f49d0a724c2419636d4c5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:09.922968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1037/2081] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:09 2022] DELETE /identity/v3/users/84b591b5e75f49d0a724c2419636d4c5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:09.928578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:09.929102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:09.929392 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:09.955591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:09.957608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:09.974861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f1780-06f2-48c3-a4af-0c1e60692c2f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.000771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:10.024579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1038/2082] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:10.034120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.035764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.038148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.038775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.039056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.039334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.040124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.042504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.066310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1045/2083] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:09 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:10.070816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.082127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8054e6-59e3-4a75-b505-f1936b066bf8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.086904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.087540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.087857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.088139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.088834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.090479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.100428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1046/2084] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:10.104354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.105555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a856021-bff3-492a-8443-baddd441ae08 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.109853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.110478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.110762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.111040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.115187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6ee82-983b-485e-be41-e34e63a92382 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.120111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.120598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.120726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.120972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.121243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.122676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.122933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.124323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c766a2a-9ec3-4690-b090-86808b34aa31 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.134063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1039/2085] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:10.136110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1047/2086] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:10.140980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.151489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd90f9-96ad-4f86-a98e-cb26c03fca1d service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.156268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.156923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.157203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.157476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] PATH_INFO: `/v3/projects/3fd9421ccf42494783ee196751e35a88/users/f28190b77da34b7aade7e47db92722e0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.173628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd9421ccf42494783ee196751e35a88, user_id=f28190b77da34b7aade7e47db92722e0, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.176319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.199345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1040/2087] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:10 2022] PUT /identity/v3/projects/3fd9421ccf42494783ee196751e35a88/users/f28190b77da34b7aade7e47db92722e0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:10.210157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.210377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.210892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.240932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] MFA Rules not processed for user `f28190b77da34b7aade7e47db92722e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:10.242172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.329263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1048/2088] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:10.341957 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.343912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.365209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.366737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.381827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:10.415668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863112f-2a68-4582-a3d7-4f3d85e1cdad admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.422501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.423116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.423631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.423779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.432855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.434388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.443230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d331a2-4b01-4292-a6bc-9e6531b70847 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.443796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1041/2089] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:10.444550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.445885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.457886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.458186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.458468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.458728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] PATH_INFO: `/v3/users/0ccb07fb0a114ffda2f3a4767225a638` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.459963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccb07fb0a114ffda2f3a4767225a638)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.460684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335f60-bf27-49be-953f-91ec1edb3abf service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.461900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.472343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.473130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.473417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.473705 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] PATH_INFO: `/v3/projects/299a4b041f7b44f0bbc1b62ed40cfcab` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.475428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299a4b041f7b44f0bbc1b62ed40cfcab)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.477726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.531956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccb07fb0a114ffda2f3a4767225a638'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.532985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccb07fb0a114ffda2f3a4767225a638'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.539634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299a4b041f7b44f0bbc1b62ed40cfcab', 'request_id': 'req-222807a7-95c4-4618-a188-c50988f334d9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.542055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccb07fb0a114ffda2f3a4767225a638'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.550738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299a4b041f7b44f0bbc1b62ed40cfcab', 'request_id': 'req-222807a7-95c4-4618-a188-c50988f334d9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.552303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccb07fb0a114ffda2f3a4767225a638'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.553400 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:10.558698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299a4b041f7b44f0bbc1b62ed40cfcab', 'request_id': 'req-222807a7-95c4-4618-a188-c50988f334d9'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.566817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccb07fb0a114ffda2f3a4767225a638'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.572087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] The token cache is being invalidate because project 299a4b041f7b44f0bbc1b62ed40cfcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:10.572379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.573042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-222807a7-95c4-4618-a188-c50988f334d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.573859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1049/2090] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:10 2022] DELETE /identity/v3/users/0ccb07fb0a114ffda2f3a4767225a638 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:10.574613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1042/2091] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:10 2022] DELETE /identity/v3/projects/299a4b041f7b44f0bbc1b62ed40cfcab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:10.579794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.580026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.580371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.580631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.581229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.600664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:10.602075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.662281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8400e8-82fc-470a-9910-ef3c1ca0e8ce admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.669382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.669731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.670012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.670283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] PATH_INFO: `/v3/users/b4d05905fb5841a3a462ef447548c2cc` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.671936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d05905fb5841a3a462ef447548c2cc)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.674683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.684565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1043/2092] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:10.696735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:10.698667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.728612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:10.755194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d05905fb5841a3a462ef447548c2cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.756626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d05905fb5841a3a462ef447548c2cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.768808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d05905fb5841a3a462ef447548c2cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.780969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d05905fb5841a3a462ef447548c2cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.801539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d05905fb5841a3a462ef447548c2cc'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:10.806618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7300d44-2dab-41b0-b6b8-b121f8dfc4fc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:10.820766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1050/2093] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:10 2022] DELETE /identity/v3/users/b4d05905fb5841a3a462ef447548c2cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:10.882042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:10.883060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:10.883385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:10.883681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:10.886982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:10.954610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:10.960515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:10.962246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21365564-6bc1-4198-992e-794963f9eab6 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:10.976790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1044/2094] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:11.120789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.121746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.152339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd28e34-471f-4a7f-8175-1b8feea5f519 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.159427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.160117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.160661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.160936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] PATH_INFO: `/v3/projects/7058620dc2814df6b7f445003f799d93` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.162133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7058620dc2814df6b7f445003f799d93)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.164084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.217116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7058620dc2814df6b7f445003f799d93', 'request_id': 'req-721fa704-d495-4b98-ae9e-9eb1a468c89a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.224301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7058620dc2814df6b7f445003f799d93', 'request_id': 'req-721fa704-d495-4b98-ae9e-9eb1a468c89a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.230269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7058620dc2814df6b7f445003f799d93', 'request_id': 'req-721fa704-d495-4b98-ae9e-9eb1a468c89a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.243078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] The token cache is being invalidate because project 7058620dc2814df6b7f445003f799d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:11.243462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.244200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.245814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1051/2095] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:11 2022] DELETE /identity/v3/projects/7058620dc2814df6b7f445003f799d93 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:11.252210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a731-749e-4bff-8628-882da844f635 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.252502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a731-749e-4bff-8628-882da844f635 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.252783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32a731-749e-4bff-8628-882da844f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.273245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ba32a731-749e-4bff-8628-882da844f635 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:11.274619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ba32a731-749e-4bff-8628-882da844f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.292595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.294837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.344086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1045/2096] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:11.352398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818663-e154-4694-b485-c8ff54405301 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.352950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818663-e154-4694-b485-c8ff54405301 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.353401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818663-e154-4694-b485-c8ff54405301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.373770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-45818663-e154-4694-b485-c8ff54405301 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:11.375147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fa704-d495-4b98-ae9e-9eb1a468c89a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.375273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45818663-e154-4694-b485-c8ff54405301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.379987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.380643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.380926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.381202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] PATH_INFO: `/v3/projects/5429201dc1ba48759494887f5517efe2` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.382412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5429201dc1ba48759494887f5517efe2)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.384094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1046/2097] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:11.387556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.388225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818663-e154-4694-b485-c8ff54405301 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.397551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818663-e154-4694-b485-c8ff54405301 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.403337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.404043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.404317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.404645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.405377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:11.405724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.407662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.421055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1047/2098] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:11.425351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.433268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:11.435330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3801e-a683-494d-9f0a-bc561cdf5d8c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.451640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5429201dc1ba48759494887f5517efe2', 'request_id': 'req-1033fa97-2c33-422d-97c0-9a25563ef37b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.460070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5429201dc1ba48759494887f5517efe2', 'request_id': 'req-1033fa97-2c33-422d-97c0-9a25563ef37b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.467011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5429201dc1ba48759494887f5517efe2', 'request_id': 'req-1033fa97-2c33-422d-97c0-9a25563ef37b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.478282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] The token cache is being invalidate because project 5429201dc1ba48759494887f5517efe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:11.478499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.479173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1033fa97-2c33-422d-97c0-9a25563ef37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:11.480792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1052/2099] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:11 2022] DELETE /identity/v3/projects/5429201dc1ba48759494887f5517efe2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:11.486108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309275dc-998a-447a-96a6-8111cf52c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.486668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309275dc-998a-447a-96a6-8111cf52c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.486972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309275dc-998a-447a-96a6-8111cf52c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.497993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.498616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.498903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.499216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.499918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.501846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.506239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-309275dc-998a-447a-96a6-8111cf52c8c8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:11.507440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-309275dc-998a-447a-96a6-8111cf52c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.516049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1053/2100] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:11.524589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.524902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.525180 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.533922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1048/2101] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:11.534942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.536821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.545041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:11.546212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.601654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2e096-8857-4de2-9b7b-6b66df9df9fe admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.606096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1054/2102] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:11.606679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.607300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.607586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.607902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.608573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.609989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.610522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.618480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:11.619256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea219-ae94-49ec-b422-2f4046304906 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.624823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.625496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.625811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.626090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.626871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:11.627090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.628885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.634903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1049/2103] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:11.639833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.647416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1055/2104] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:11.648498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.652596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d632e0-596c-419a-ab35-09f87a8fc7bc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.660154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b4eea-758b-44ad-8aaf-149ea8502f43 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.660727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.661355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.661645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.661931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.662642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.664586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.665495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.666078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.666362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.666646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.667351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.669312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.675068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1050/2105] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:11.679040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.689418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb9b50-6126-490b-8f50-1c3897692257 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.694560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.695174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.695460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.695737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.696450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.701207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1056/2106] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:11.701337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.702340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.713024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1051/2107] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:11.714260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.724591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5931-2bd0-4a71-b062-ee636963831d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.767465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620eb6a-2418-42d0-a072-f1f1ba40728d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.772913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.773528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.773806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.774082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.774740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.776891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.783460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.784166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.784451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.784729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] PATH_INFO: `/v3/projects/56cf6586ad1044a3b98b43873f8f9631/users/50fd3dba6ebb46618e03f0c360db4dc0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.800112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1057/2108] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:11.800805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cf6586ad1044a3b98b43873f8f9631, user_id=50fd3dba6ebb46618e03f0c360db4dc0, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.803959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894bd1c-c3cf-4c3d-b598-6c46d782ca59 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.804164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.815224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5fbb-5c42-4fd4-ae6d-a0e8f1eb6d44 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.820410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1052/2109] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:11 2022] PUT /identity/v3/projects/56cf6586ad1044a3b98b43873f8f9631/users/50fd3dba6ebb46618e03f0c360db4dc0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:11.828953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:11.831571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.831903 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.832182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.862054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] MFA Rules not processed for user `50fd3dba6ebb46618e03f0c360db4dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:11.864651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:11.884681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.885307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.885594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.885871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.886580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.888764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.901195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1058/2110] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:11.906850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.921102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf90f8-fc45-4e2d-a2b3-8833d1c95789 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.927249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.927913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.928204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.928490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.929257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.931148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.942499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1059/2111] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:11.947598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.954816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1053/2112] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:11.959545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:11.963928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2971e4-94ec-4f50-a3e8-5e04a596dcd7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.972830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.973583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.974689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8994575-d87a-42ff-ac8c-4c062a64242a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:11.974911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.975382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] PATH_INFO: `/v3/projects/d83ba71cc04e401ab9ab8ecb760abbe4/users/511ce2c1100049218a2d63ef513a7cbd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.987948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:11.988592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:11.989401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:11.989799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:11.990850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:11.993212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:11.997908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83ba71cc04e401ab9ab8ecb760abbe4, user_id=511ce2c1100049218a2d63ef513a7cbd, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.002676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e57040-eae4-4345-af01-a260cdd8f718 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.021901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1060/2113] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:11 2022] PUT /identity/v3/projects/d83ba71cc04e401ab9ab8ecb760abbe4/users/511ce2c1100049218a2d63ef513a7cbd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:12.032772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1054/2114] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:11 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:12.039660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.039660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.039660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.044134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.071412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:12.082402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] MFA Rules not processed for user `511ce2c1100049218a2d63ef513a7cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:12.083945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:12.151926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6602ee6-109c-4fb3-85ff-68ee638a306c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.157485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.158117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.158412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.158907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.159887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.161989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.180426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1061/2115] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:12.190078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1055/2116] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:12 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:12.192428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.193627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.194774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:12.207466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff503c-3315-4ac7-a6b4-5fcae3cd8165 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.212472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.213131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.213406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.213682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.214693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.216618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.227985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1056/2117] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:12.232544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.243535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d39b82-9dba-4627-9c09-cd0445787099 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.250297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.250992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.251300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.251581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] PATH_INFO: `/v3/projects/113e777127694ac888de4bfbdb1a4126/users/3e9ac47165e74700b586dae2ea5affb0/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.268668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=113e777127694ac888de4bfbdb1a4126, user_id=3e9ac47165e74700b586dae2ea5affb0, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.271435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.278515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b5f82-a59f-461a-9ac3-f025e1d6f927 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.284927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1057/2118] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:12 2022] PUT /identity/v3/projects/113e777127694ac888de4bfbdb1a4126/users/3e9ac47165e74700b586dae2ea5affb0/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:12.289040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.292251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:12.336768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.337386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.337662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.337932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.354038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138b8b-4016-4a09-acfe-e3cb7d8b0e7a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.359631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.360281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.360562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.360837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.361533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.363146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.373744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1058/2119] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:12.377858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.387612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d2802-c59a-4a03-916e-a39524248572 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.392377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.393039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.393324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.393600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] PATH_INFO: `/v3/projects/113e777127694ac888de4bfbdb1a4126/users/3e9ac47165e74700b586dae2ea5affb0/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.395827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113e777127694ac888de4bfbdb1a4126, user_id=3e9ac47165e74700b586dae2ea5affb0, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.398715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.399075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.400336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f0fb1-0ef7-44f4-9653-11490e6e839e service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.409848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1062/2120] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:12.410127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1059/2121] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:12 2022] PUT /identity/v3/projects/113e777127694ac888de4bfbdb1a4126/users/3e9ac47165e74700b586dae2ea5affb0/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:12.421901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.422188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.422467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.453699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] MFA Rules not processed for user `3e9ac47165e74700b586dae2ea5affb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:12.454911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:12.531243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1063/2122] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:12.542159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.544858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:12.611599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841a22f-9c6c-4814-a603-9399c5590fe3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.617671 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.618404 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.618703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.618993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.630418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.631906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668670d6-404c-461e-9fa8-e19934d0af60 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.636075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:12.645770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1060/2123] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:12.808598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:12.866695 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:12.871283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3baf69c-22e3-4ad2-a764-51f3972a178b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:12.876076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:12.876715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.876999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.877279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] PATH_INFO: `/v3/users/50fd3dba6ebb46618e03f0c360db4dc0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.878441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fd3dba6ebb46618e03f0c360db4dc0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:12.880456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:12.927759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fd3dba6ebb46618e03f0c360db4dc0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:12.928419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fd3dba6ebb46618e03f0c360db4dc0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:12.935635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fd3dba6ebb46618e03f0c360db4dc0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:12.942660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fd3dba6ebb46618e03f0c360db4dc0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:12.955495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fd3dba6ebb46618e03f0c360db4dc0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:12.961932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1064/2124] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:12 2022] DELETE /identity/v3/users/50fd3dba6ebb46618e03f0c360db4dc0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:12.966972 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:12.967259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:12.967538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:12.988562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:12.989755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.048606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1061/2125] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:13.058544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:13.060598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.117452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad13b9-8062-49c2-a87b-c6508735d3a5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:13.121236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:13.121997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.122275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.122549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.131438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:13.132960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be5f76-97ad-49ec-bbaa-f4019f5850c9 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:13.143284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1065/2126] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:13.316790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:13.318660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.335173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f82e6-2bd2-4a4f-9bbc-a091ad5f3fa1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:13.341344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:13.342227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.353365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.353799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] PATH_INFO: `/v3/users/5a65b625270349fcac10e5cc116f40b2` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.355315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a65b625270349fcac10e5cc116f40b2)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:13.357487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:13.414401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a65b625270349fcac10e5cc116f40b2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.415384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a65b625270349fcac10e5cc116f40b2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.422670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a65b625270349fcac10e5cc116f40b2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.430361 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a65b625270349fcac10e5cc116f40b2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.430965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a65b625270349fcac10e5cc116f40b2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.450656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1062/2127] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:13 2022] DELETE /identity/v3/users/5a65b625270349fcac10e5cc116f40b2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:13.455204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.455706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.455859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.477656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:13.479158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.483866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:13.485263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.555867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1066/2128] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:13.560098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21a6ba-2ba8-44e3-85ba-2f263440dc80 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:13.564867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:13.565511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.565764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:13.565862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.566063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] PATH_INFO: `/v3/projects/56cf6586ad1044a3b98b43873f8f9631` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.567231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cf6586ad1044a3b98b43873f8f9631)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:13.567332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.569200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:13.581700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:13.590635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:13.618473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cf6586ad1044a3b98b43873f8f9631', 'request_id': 'req-5b799253-8563-4a0b-9d3d-df3f718770e4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.626577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cf6586ad1044a3b98b43873f8f9631', 'request_id': 'req-5b799253-8563-4a0b-9d3d-df3f718770e4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.629070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa558f-788b-44fb-b2e4-0910ea7bcd73 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:13.632651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cf6586ad1044a3b98b43873f8f9631', 'request_id': 'req-5b799253-8563-4a0b-9d3d-df3f718770e4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.644320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] The token cache is being invalidate because project 56cf6586ad1044a3b98b43873f8f9631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:13.644606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.645255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.646775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1063/2129] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:13 2022] DELETE /identity/v3/projects/56cf6586ad1044a3b98b43873f8f9631 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:13.650787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:13.652121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.678832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:13.679453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.679734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.680036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.681787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.719619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799253-8563-4a0b-9d3d-df3f718770e4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:13.724945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:13.725584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.725867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.726142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] PATH_INFO: `/v3/users/3e9ac47165e74700b586dae2ea5affb0` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.727310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9ac47165e74700b586dae2ea5affb0)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:13.729281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:13.749696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:13.751077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28ca56-5d61-4325-a628-609fd2b62c17 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:13.761648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1067/2130] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:13.783331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9ac47165e74700b586dae2ea5affb0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.784033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9ac47165e74700b586dae2ea5affb0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.792846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9ac47165e74700b586dae2ea5affb0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.803044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9ac47165e74700b586dae2ea5affb0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.803873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9ac47165e74700b586dae2ea5affb0'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:13.810081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:13.810332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:13.810582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:13.827342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1064/2131] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:13 2022] DELETE /identity/v3/users/3e9ac47165e74700b586dae2ea5affb0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:13.832666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] MFA Rules not processed for user `511ce2c1100049218a2d63ef513a7cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:13.834016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:13.901887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1068/2132] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:14.439436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.441132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.512470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.515267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.527229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:14.598479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:14.620067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8968c-8de9-46c5-9750-b6fe9e8f721f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.653159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.653159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.653159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.653159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] PATH_INFO: `/v3/projects/5b11e6c13a494a01bbfcc3674ae72039` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.654072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b11e6c13a494a01bbfcc3674ae72039)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.654072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:14.661933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1e04a-63ad-4322-af73-d6bb5388ded6 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.667003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.667768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.668069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.668904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] PATH_INFO: `/v3/projects/113e777127694ac888de4bfbdb1a4126` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.670097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113e777127694ac888de4bfbdb1a4126)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.672055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:14.716604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b11e6c13a494a01bbfcc3674ae72039', 'request_id': 'req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.724535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b11e6c13a494a01bbfcc3674ae72039', 'request_id': 'req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.727576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113e777127694ac888de4bfbdb1a4126', 'request_id': 'req-cd46272d-4d26-4804-9544-5a66a7183962'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.732757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b11e6c13a494a01bbfcc3674ae72039', 'request_id': 'req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.737726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113e777127694ac888de4bfbdb1a4126', 'request_id': 'req-cd46272d-4d26-4804-9544-5a66a7183962'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.744867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113e777127694ac888de4bfbdb1a4126', 'request_id': 'req-cd46272d-4d26-4804-9544-5a66a7183962'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.748352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] The token cache is being invalidate because project 5b11e6c13a494a01bbfcc3674ae72039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:14.748781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.749653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-6a9e5cf0-7b2f-4dbc-8529-8d34a9cec953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.751283 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1065/2133] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:14 2022] DELETE /identity/v3/projects/5b11e6c13a494a01bbfcc3674ae72039 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:14.756089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bf34-f128-4adc-bd96-670dd921a69f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.756391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bf34-f128-4adc-bd96-670dd921a69f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.756666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696bf34-f128-4adc-bd96-670dd921a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.762186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] The token cache is being invalidate because project 113e777127694ac888de4bfbdb1a4126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:14.762737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.763935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cd46272d-4d26-4804-9544-5a66a7183962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:14.765930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1069/2134] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:14 2022] DELETE /identity/v3/projects/113e777127694ac888de4bfbdb1a4126 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:14.770761 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be759c-c92b-48e0-843d-eaf5f028d32a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.771128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be759c-c92b-48e0-843d-eaf5f028d32a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.771444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be759c-c92b-48e0-843d-eaf5f028d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.785395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9696bf34-f128-4adc-bd96-670dd921a69f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:14.787207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9696bf34-f128-4adc-bd96-670dd921a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.796868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-98be759c-c92b-48e0-843d-eaf5f028d32a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:14.798576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-98be759c-c92b-48e0-843d-eaf5f028d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.869206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1066/2135] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:14.873719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1070/2136] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:14.877760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.878049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.878338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.881753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.882050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.882562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.899230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:14.900432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.903572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:14.904988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:14.909547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1067/2137] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:14.914683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1071/2138] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:14.916107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.919014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.926625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b4780-ffe5-4cf1-83db-d8acc4b5a360 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.928571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0586b5-95ce-411c-a22d-ea6b831006a1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.932103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.932715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.933198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.933299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.933518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.934229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.934338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:14.934424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.934617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.934716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.935377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:14.935690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.936421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:14.937573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:14.949065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1068/2139] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:00:14.949966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1072/2140] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:14.953649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.954402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:14.967391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c447bc-1104-4af8-b44e-96f489314386 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.967789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bb371-4471-4270-9426-c7c39f29a6c2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:14.972895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.973269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:14.973871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.973981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:14.974185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.974289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:14.974403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.974644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:14.975068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.975511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:14.977035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:14.977920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.009044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1073/2141] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:15.009754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1069/2142] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:14 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:15.012946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.013598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.024946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:15.045745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:15.093634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501dad-1614-433c-9d7b-491e416f0bae admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.099046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.099650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987b41d-1fa4-441c-92ae-ae10046eaaf8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.100029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.100432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.100821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.101488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.103710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.105246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.106519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.106797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.107099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.107831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.110737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.129714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1070/2143] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:15.133560 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.139277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1074/2144] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:15.143253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.143603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c2af1-321f-4567-9a9b-34e48ad22a70 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.148519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.149181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.149472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.149745 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.150454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.152134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.153942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac2e6-123d-4b74-96dc-1693ad6551a3 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.159029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.159637 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.159951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.160495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.161194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.162790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.163791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1071/2145] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:15.168225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.174042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1075/2146] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:15.177893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.180781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195995d0-a960-41bc-96bd-1bbd3e788cfc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.189123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.189807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.190100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.190430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.191146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.192816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.196232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe20d8-343b-4f9b-b775-448b4fd33122 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.201691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.202533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.202832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.203114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.203986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.205230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1072/2147] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:15.205837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.209794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.221545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36bdd4-0259-4f58-844a-12dbd7e7f4d5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.224022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1076/2148] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:00:15.225299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.227102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.227797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.228081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.228358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] PATH_INFO: `/v3/projects/2fcedb795be940ee9db3e719e7926a18/users/e5d45702098442ad87a92f3ccca8bc92/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.237414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44471e-e3a9-48c5-ae77-532d7665003c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.242177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.242837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.243455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.243455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] PATH_INFO: `/v3/projects/df0222fdd4d8429ebcf0856278e8b480/users/02ffeec56d924c53808ac268473986ce/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.245725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcedb795be940ee9db3e719e7926a18, user_id=e5d45702098442ad87a92f3ccca8bc92, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.248537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f0ba1-e5da-48e6-8878-779ab189a9c7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.259710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0222fdd4d8429ebcf0856278e8b480, user_id=02ffeec56d924c53808ac268473986ce, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.262957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eb7bc-b0f5-41ce-9231-22d702596f3c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.264530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1073/2149] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:15 2022] PUT /identity/v3/projects/2fcedb795be940ee9db3e719e7926a18/users/e5d45702098442ad87a92f3ccca8bc92/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:15.273336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.273626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.273902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.281748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1077/2150] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:15 2022] PUT /identity/v3/projects/df0222fdd4d8429ebcf0856278e8b480/users/02ffeec56d924c53808ac268473986ce/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:15.293241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.293526 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.293840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.296431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:15.297652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:15.322806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] MFA Rules not processed for user `02ffeec56d924c53808ac268473986ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:15.324023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:15.360668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1074/2151] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:15.369979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.371465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:15.393896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1078/2152] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:15.398449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.409134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62f2e-c77b-4712-a2ec-feeb55e7d638 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.413928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.414532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.414809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.415098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.415849 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.417760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.428834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179fc23-21d3-4db3-ab7b-30f95bf341cb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.432570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.433184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.433463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.433762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.440961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:15.443195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.445141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.448693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1079/2153] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:15.450304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.456494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1075/2154] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:15.489064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:15.519664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea0ba-5e39-4b16-a97f-b42e432f9606 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.524773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.525386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.525670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.525946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.526622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.529176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.550459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1080/2155] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:00:15.554355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.565801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f8e2-d0d7-4552-a211-6cdacd8da99f service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.570696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.571390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.571767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.572125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.572902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.575291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.590899 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1076/2156] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:15.591328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.602577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ece4b-9cde-4540-9c14-1270677069d9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.608149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.608973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.609333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.609685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] PATH_INFO: `/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83/users/3354aaab28a347d5889ba0954b8eee46/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.630346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dd19bb6c134115b05528ffc1c5fc83, user_id=3354aaab28a347d5889ba0954b8eee46, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.636301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.663480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1081/2157] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:15 2022] PUT /identity/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83/users/3354aaab28a347d5889ba0954b8eee46/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:15.664783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.678644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629558b3-d6a6-4add-9b56-138bc61dbd07 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.763388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.764243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.764673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.765535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.767032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.769218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cf0e0-a12b-439b-9535-09cc4258667b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.782692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1077/2158] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:15.786939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:15.802579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251616d-119b-409c-9f3c-23860d179470 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:15.810036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:15.811008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.811410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.811858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] PATH_INFO: `/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83/users/3354aaab28a347d5889ba0954b8eee46/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.814813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dd19bb6c134115b05528ffc1c5fc83, user_id=3354aaab28a347d5889ba0954b8eee46, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:15.817848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:15.843002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1082/2159] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:15 2022] PUT /identity/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83/users/3354aaab28a347d5889ba0954b8eee46/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:15.853836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be520a-bd97-448f-a4c7-a8edc209979b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:15.854198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be520a-bd97-448f-a4c7-a8edc209979b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:15.854554 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be520a-bd97-448f-a4c7-a8edc209979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:15.900546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c6be520a-bd97-448f-a4c7-a8edc209979b None None] MFA Rules not processed for user `3354aaab28a347d5889ba0954b8eee46`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:15.902779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c6be520a-bd97-448f-a4c7-a8edc209979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:16.046219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1078/2160] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:16.062115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:16.066939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:16.165184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4e44-99fc-4365-89b3-ef6dea4625ee admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:16.173237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:16.174296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:16.174668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:16.175057 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:16.187972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:16.190866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:16.204670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1083/2161] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:16.591963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:16.592353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:16.592725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:16.657639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] MFA Rules not processed for user `e5d45702098442ad87a92f3ccca8bc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:16.659102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:16.788078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:16.801526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1079/2162] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:16.813171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:16.814653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:16.832595 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f74a1-10b7-4e2d-b0e8-b3dbdc593c16 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:16.843923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:16.844558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:16.844840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:16.845112 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:16.866852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:16.868405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4a5bb-c417-4b09-b7b8-fa87583039ee service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:16.884561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1084/2163] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:17.261131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:17.366042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fba0c-ea37-41c5-82a2-733f6c6fe8ce None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:17.371883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:17.372619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:17.372997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:17.373387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] PATH_INFO: `/v3/users/02ffeec56d924c53808ac268473986ce` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:17.374867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ffeec56d924c53808ac268473986ce)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:17.376859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:17.440662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ffeec56d924c53808ac268473986ce'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:17.441416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ffeec56d924c53808ac268473986ce'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:17.451710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ffeec56d924c53808ac268473986ce'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:17.460682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ffeec56d924c53808ac268473986ce'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:17.461315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ffeec56d924c53808ac268473986ce'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:17.482915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1080/2164] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:17 2022] DELETE /identity/v3/users/02ffeec56d924c53808ac268473986ce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:17.487379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:17.487737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:17.488171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:17.507463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:17.508755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:17.571517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1085/2165] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:17.581523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:17.582940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:17.644135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9873a-52e4-4e92-8b33-5dcc4e35193d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:17.647865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:17.648520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:17.648810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:17.649087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:17.659113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:17.660884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:17.671955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1081/2166] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:18.140440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:18.141908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:18.154307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1313ac-84f0-471f-9dbd-b426ee69d722 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:18.158970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:18.159615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:18.159958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:18.160504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] PATH_INFO: `/v3/projects/df0222fdd4d8429ebcf0856278e8b480` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:18.161681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0222fdd4d8429ebcf0856278e8b480)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:18.163624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:18.172736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:18.228041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0222fdd4d8429ebcf0856278e8b480', 'request_id': 'req-f52b1efa-359b-41bb-9d80-a3b7299edf4e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.238845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0222fdd4d8429ebcf0856278e8b480', 'request_id': 'req-f52b1efa-359b-41bb-9d80-a3b7299edf4e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.245362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0222fdd4d8429ebcf0856278e8b480', 'request_id': 'req-f52b1efa-359b-41bb-9d80-a3b7299edf4e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.261302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] The token cache is being invalidate because project df0222fdd4d8429ebcf0856278e8b480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:18.261756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.262846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f52b1efa-359b-41bb-9d80-a3b7299edf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.265061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1086/2167] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:18 2022] DELETE /identity/v3/projects/df0222fdd4d8429ebcf0856278e8b480 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:18.269125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:18.279256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeaa17-4544-44dc-b18b-9a9f45066c71 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:18.295430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:18.353796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:18.354456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:18.354741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:18.355019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] PATH_INFO: `/v3/users/3354aaab28a347d5889ba0954b8eee46` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:18.357051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3354aaab28a347d5889ba0954b8eee46)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:18.359138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:18.396377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989627cf-cf6d-4850-b0dd-33d322d076b1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:18.397157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989627cf-cf6d-4850-b0dd-33d322d076b1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:18.397850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989627cf-cf6d-4850-b0dd-33d322d076b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:18.420225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3354aaab28a347d5889ba0954b8eee46'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.421179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3354aaab28a347d5889ba0954b8eee46'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.422933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-989627cf-cf6d-4850-b0dd-33d322d076b1 None None] MFA Rules not processed for user `e5d45702098442ad87a92f3ccca8bc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:18.424218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-989627cf-cf6d-4850-b0dd-33d322d076b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:18.430176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3354aaab28a347d5889ba0954b8eee46'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.439716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3354aaab28a347d5889ba0954b8eee46'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.440546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3354aaab28a347d5889ba0954b8eee46'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:18.461045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1082/2168] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:18 2022] DELETE /identity/v3/users/3354aaab28a347d5889ba0954b8eee46 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:18.493493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1087/2169] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:18.875960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:18.877414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:18.958146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67cd6c-fd3e-4376-abe0-5459afc6bc59 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:18.963490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:18.964127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:18.964412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:18.965161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] PATH_INFO: `/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:18.966038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dd19bb6c134115b05528ffc1c5fc83)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:18.967915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.020947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:19.036288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dd19bb6c134115b05528ffc1c5fc83', 'request_id': 'req-f4e0f520-b575-4a66-8f6a-0b31d13555c8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.045764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dd19bb6c134115b05528ffc1c5fc83', 'request_id': 'req-f4e0f520-b575-4a66-8f6a-0b31d13555c8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.058085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dd19bb6c134115b05528ffc1c5fc83', 'request_id': 'req-f4e0f520-b575-4a66-8f6a-0b31d13555c8'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.070242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] The token cache is being invalidate because project f1dd19bb6c134115b05528ffc1c5fc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:19.070395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.071055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-f4e0f520-b575-4a66-8f6a-0b31d13555c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.072714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1083/2170] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:18 2022] DELETE /identity/v3/projects/f1dd19bb6c134115b05528ffc1c5fc83 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:19.078369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.078729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.079079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.101878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:19.103234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:19.195922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1088/2171] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:19.199220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.199965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.200566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.226726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:19.228108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:19.238170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1084/2172] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:19.242865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.258657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1d335-9033-427f-8ce5-a60526a1cd11 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.274153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.275014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.275296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.275786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.277279 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:00:19.277440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.279048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.300169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1089/2173] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:00:19.300515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.311803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7e9b7-0783-49b5-80e5-ecce5be140d3 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.317030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.317678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.317965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.318214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.318882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.320893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.349951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1085/2174] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:00:19 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:19.354359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.366741 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4c86-6e18-4ac2-9234-932cca9e22b4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.397804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:19.434248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.435154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.435508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.435900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.436660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.438715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.474439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1090/2175] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:00:19 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:00:19.475397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.488034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88000-aadd-4cd5-a577-5921d33fc14b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.493277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.493908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.494203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.494475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.495184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.496854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.511349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1086/2176] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:19.512551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.523770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e67400-a53d-4da2-b1be-b013409b6184 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.530048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.530674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.531210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.531656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.532257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.533979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee8333-2995-4c8d-a2e9-0ce5d1bc1bfb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.551775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1091/2177] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:00:19.556058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.567341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367a23-e786-4973-8d6f-d6c1b3fc2812 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.573026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.573713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.573996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.574309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] PATH_INFO: `/v3/projects/01da45bd1f024d1b87746f157b482e8e/users/e6e7e8d9ee9541ff9db9f123dd9f45af/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.592773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01da45bd1f024d1b87746f157b482e8e, user_id=e6e7e8d9ee9541ff9db9f123dd9f45af, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.607321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.631667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1087/2178] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:00:19 2022] PUT /identity/v3/projects/01da45bd1f024d1b87746f157b482e8e/users/e6e7e8d9ee9541ff9db9f123dd9f45af/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:00:19.643325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.643618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.643927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.674694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] MFA Rules not processed for user `e6e7e8d9ee9541ff9db9f123dd9f45af`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:19.675977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:19.748608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1092/2179] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:19.759773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.762160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:19.828761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736845-f0b2-4fed-8728-c01d5a063e0c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.832523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.834133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.834801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.835070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.845430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.846906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d8c99-3949-4911-83d7-6fc20fa3c8d6 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.858116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1088/2180] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:19.877632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:19.940909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2d407-471a-4576-8b72-f735b2281549 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:19.945504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:19.946142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:19.946424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:19.946697 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] PATH_INFO: `/v3/users/e6e7e8d9ee9541ff9db9f123dd9f45af` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:19.947911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e7e8d9ee9541ff9db9f123dd9f45af)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:19.950420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:19.989884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:19.996997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e7e8d9ee9541ff9db9f123dd9f45af'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:19.997690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e7e8d9ee9541ff9db9f123dd9f45af'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.005788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e7e8d9ee9541ff9db9f123dd9f45af'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.013349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e7e8d9ee9541ff9db9f123dd9f45af'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.025676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e7e8d9ee9541ff9db9f123dd9f45af'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.032524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1093/2181] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:19 2022] DELETE /identity/v3/users/e6e7e8d9ee9541ff9db9f123dd9f45af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:20.037275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:20.037916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:20.037916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:20.057199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:20.058397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:20.120172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1089/2182] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:20.129554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:20.130950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:20.206811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d337ab-ebf1-45e4-8d03-16ccf070ee58 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:20.211731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:20.212615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:20.212968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:20.213252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:20.231439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:20.232989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:20.243433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1094/2183] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:20.755967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:20.757561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:20.769974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad7158-4e4c-4c25-b107-6c3a5168d471 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:20.774975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:20.775689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:20.776008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:20.776285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] PATH_INFO: `/v3/projects/01da45bd1f024d1b87746f157b482e8e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:20.777496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01da45bd1f024d1b87746f157b482e8e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:20.779402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:20.781314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:20.842712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01da45bd1f024d1b87746f157b482e8e', 'request_id': 'req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.850800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01da45bd1f024d1b87746f157b482e8e', 'request_id': 'req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.857233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01da45bd1f024d1b87746f157b482e8e', 'request_id': 'req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.868490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] The token cache is being invalidate because project 01da45bd1f024d1b87746f157b482e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:20.868979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.869635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-8e79f4ac-aaf3-49a8-9c59-d9663cd6ea6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:20.871209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1090/2184] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:20 2022] DELETE /identity/v3/projects/01da45bd1f024d1b87746f157b482e8e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:21.194686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:21.196295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:21.213164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa8bdb-38d9-48a8-b7e4-e3027192b7a6 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:21.287623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:21.288528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:21.288651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:21.288858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] PATH_INFO: `/v3/users/f28190b77da34b7aade7e47db92722e0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:21.290209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28190b77da34b7aade7e47db92722e0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:21.292253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:21.342248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28190b77da34b7aade7e47db92722e0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:21.342917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28190b77da34b7aade7e47db92722e0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:21.350842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28190b77da34b7aade7e47db92722e0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:21.357099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:21.359296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28190b77da34b7aade7e47db92722e0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:21.373655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28190b77da34b7aade7e47db92722e0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:21.379937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1095/2185] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:21 2022] DELETE /identity/v3/users/f28190b77da34b7aade7e47db92722e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:21.384339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:21.384631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:21.384912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:21.405591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:21.406800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:21.484307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1091/2186] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:00:21.499127 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:21.500768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:21.587325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53596e8-4cec-4f36-957c-475c5956b8a4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:21.592200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:21.592834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:21.593115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:21.593405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:21.622583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:21.624780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36db0b-dfec-48c9-b508-f3a2531bf993 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:21.637876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1096/2187] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:22.395424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:22.396983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:22.410735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896d4f6-e3c5-4222-bd5b-87ef85086c50 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:22.415396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:22.416078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:22.416365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:22.416646 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] PATH_INFO: `/v3/projects/3fd9421ccf42494783ee196751e35a88` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:22.418582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd9421ccf42494783ee196751e35a88)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:22.426738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:22.487673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd9421ccf42494783ee196751e35a88', 'request_id': 'req-ba817711-6d17-41cf-a68a-ce77f6ec57e1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:22.496373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd9421ccf42494783ee196751e35a88', 'request_id': 'req-ba817711-6d17-41cf-a68a-ce77f6ec57e1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:22.502700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd9421ccf42494783ee196751e35a88', 'request_id': 'req-ba817711-6d17-41cf-a68a-ce77f6ec57e1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:22.514258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] The token cache is being invalidate because project 3fd9421ccf42494783ee196751e35a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:22.514576 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:22.515245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:22.516822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1092/2188] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:22 2022] DELETE /identity/v3/projects/3fd9421ccf42494783ee196751e35a88 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:31.632551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=34,keystone:DELETE=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:32.511002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:32.628562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d1c9-babd-47df-9412-94e18ecb8598 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:32.628847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d1c9-babd-47df-9412-94e18ecb8598 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:32.629124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d1c9-babd-47df-9412-94e18ecb8598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:32.648818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6ad8d1c9-babd-47df-9412-94e18ecb8598 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:32.650043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6ad8d1c9-babd-47df-9412-94e18ecb8598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:32.706666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1097/2189] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:32.754044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:32.755497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:32.826983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba817711-6d17-41cf-a68a-ce77f6ec57e1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:32.832810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:32.833435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:32.833719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:32.833993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:32.844497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:32.846245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:32.854951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1093/2190] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:00:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:00:33.391356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e10d7-c040-4fb8-b133-f41865fdb891 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:33.391646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e10d7-c040-4fb8-b133-f41865fdb891 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:33.391989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e10d7-c040-4fb8-b133-f41865fdb891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:33.412819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ca0e10d7-c040-4fb8-b133-f41865fdb891 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:33.414038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ca0e10d7-c040-4fb8-b133-f41865fdb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:33.421313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1098/2191] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:33.433803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:33.444479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee20a3-4a17-4588-ae26-59b20d18310c service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:33.449537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:33.450628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:33.451015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:33.451208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:33.459937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:33.461594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:33.470710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1094/2192] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:00:33.693784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac544-d998-4923-8c88-139d5d1e49a6 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:33.694262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac544-d998-4923-8c88-139d5d1e49a6 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:33.694380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac544-d998-4923-8c88-139d5d1e49a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:33.713871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fb9ac544-d998-4923-8c88-139d5d1e49a6 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:33.715176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fb9ac544-d998-4923-8c88-139d5d1e49a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:33.723669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1099/2193] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:33.737093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:33.748523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff794fae-6fce-4a61-bb0c-29c69b0972c8 service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:33.753696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:33.754309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:33.754591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:33.754865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:33.768924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:33.770845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:33.780284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1095/2194] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:00:34.124529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:34.124973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:34.125105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:34.143799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:34.144996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:34.153387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1100/2195] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:00:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:34.168134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:34.180057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582b85-f9f7-4355-9b62-883b78a72229 service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:34.185946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:34.186556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:34.186846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:34.187121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:34.197008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:34.198662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86775a-b3f8-42b6-91a0-3152b4241b89 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:34.215459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1096/2196] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:00:36.350117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:36.352356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:36.424350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1a679-44e3-4710-a256-942dc16eee08 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:36.428770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:36.429403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:36.429679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:36.429950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] PATH_INFO: `/v3/users/511ce2c1100049218a2d63ef513a7cbd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:36.431132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511ce2c1100049218a2d63ef513a7cbd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:36.433072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:36.482845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511ce2c1100049218a2d63ef513a7cbd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.483515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511ce2c1100049218a2d63ef513a7cbd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.491119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511ce2c1100049218a2d63ef513a7cbd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.498044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511ce2c1100049218a2d63ef513a7cbd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.509562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511ce2c1100049218a2d63ef513a7cbd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.515889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1101/2197] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:00:36 2022] DELETE /identity/v3/users/511ce2c1100049218a2d63ef513a7cbd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:36.520269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:36.520731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:36.520848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:36.540908 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:36.542116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:36.600969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1097/2198] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:36.610663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:36.612191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:36.618818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:36.671829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6074c5-9662-4430-8438-f4fb92255525 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:36.675598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:36.676194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:36.676497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:36.676790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:36.686756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:36.688577 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341c16c-0532-414e-86c3-dca6723b8dc0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:36.698310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1102/2199] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:00:36.884331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:36.886253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:36.900796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85927e9a-74fe-4d14-acf4-dab378585677 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:36.905915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:36.906562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:36.906848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:36.907154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] PATH_INFO: `/v3/projects/d83ba71cc04e401ab9ab8ecb760abbe4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:36.908627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83ba71cc04e401ab9ab8ecb760abbe4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:36.910845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:36.975303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:36.979574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83ba71cc04e401ab9ab8ecb760abbe4', 'request_id': 'req-3b38af09-22a5-4315-b097-ef08b97a749e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.989618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83ba71cc04e401ab9ab8ecb760abbe4', 'request_id': 'req-3b38af09-22a5-4315-b097-ef08b97a749e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:36.997669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83ba71cc04e401ab9ab8ecb760abbe4', 'request_id': 'req-3b38af09-22a5-4315-b097-ef08b97a749e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:37.011162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] The token cache is being invalidate because project d83ba71cc04e401ab9ab8ecb760abbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:00:37.011600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:37.012948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b38af09-22a5-4315-b097-ef08b97a749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:00:37.014558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1098/2200] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:00:36 2022] DELETE /identity/v3/projects/d83ba71cc04e401ab9ab8ecb760abbe4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:00:46.693934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=24 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:47.007439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:00:47.808443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:47.809462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:47.809566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:47.829119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] MFA Rules not processed for user `b23a317904864972b875257cfcd90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:47.830313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:47.884183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1103/2201] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:52.817649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad9cd-03d6-4c4a-8767-585b8fc29d54 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:52.818110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad9cd-03d6-4c4a-8767-585b8fc29d54 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:52.818327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad9cd-03d6-4c4a-8767-585b8fc29d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:52.838055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-23aad9cd-03d6-4c4a-8767-585b8fc29d54 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:52.839265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-23aad9cd-03d6-4c4a-8767-585b8fc29d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:52.899651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1099/2202] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:52.913770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:52.915193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:52.988790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76d3b7-9653-497a-a494-7c2fff487e4e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:52.994373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:52.994997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:52.995277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:52.995551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:53.004376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:53.005957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:53.015310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1104/2203] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:00:58.926412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797382-5cf2-4fbb-b6e5-bbe46385eab1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:58.926914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797382-5cf2-4fbb-b6e5-bbe46385eab1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:58.927027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51797382-5cf2-4fbb-b6e5-bbe46385eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:58.947136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-51797382-5cf2-4fbb-b6e5-bbe46385eab1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:00:58.948373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-51797382-5cf2-4fbb-b6e5-bbe46385eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:58.956942 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1100/2204] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:00:58.973713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:00:58.975192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:00:58.990124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ce027-a9e6-41d6-977a-aefbff588669 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:00:58.995890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:00:58.997086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:00:58.997375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:00:58.997654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:00:59.006153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:00:59.007788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f58f9-b153-42cd-8255-9105e64d490c service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:00:59.018085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1105/2205] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:04.005107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:04.005508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:04.005841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:04.025275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] MFA Rules not processed for user `ab4b1b421a35490fa717ad21dc46eb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:04.026479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:04.089244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1101/2206] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:04.315304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa73ba-2435-45c7-af82-27075d150f25 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:04.315930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa73ba-2435-45c7-af82-27075d150f25 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:04.315930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa73ba-2435-45c7-af82-27075d150f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:04.337592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c2fa73ba-2435-45c7-af82-27075d150f25 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:04.339037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c2fa73ba-2435-45c7-af82-27075d150f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:04.347155 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1106/2207] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:04.366978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:04.380829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19d78-4ba8-46a8-b30b-d4f45433a1f0 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:04.386741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:04.387123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:04.387410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:04.387691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:04.396518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:04.398190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef61144-0abf-49e6-bbff-d31e7896aed5 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:04.407977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1102/2208] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:08.419633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:08.420183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:08.420294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:08.446042 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5a91-c8b2-4e53-89f8-d750f5ba171b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:08.446533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:08.447089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5a91-c8b2-4e53-89f8-d750f5ba171b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:08.447515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5a91-c8b2-4e53-89f8-d750f5ba171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:08.447984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:08.478040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-25fc5a91-c8b2-4e53-89f8-d750f5ba171b None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:08.479620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-25fc5a91-c8b2-4e53-89f8-d750f5ba171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:08.480597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1107/2209] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:08.497493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:08.513951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7823263-0eb5-4c47-b752-e7befc55f306 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:08.520793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:08.521992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:08.522522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:08.522959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:08.535495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:08.537289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:08.551696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1108/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:01:08.576327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1103/2211] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:01:08.583986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:08.585994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:08.667031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:08.686442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f9e5-d131-4f5b-a69e-ced42bad86c1 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:08.692867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:08.693696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:08.695862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:08.696863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:08.706943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:08.708841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:08.722498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1109/2212] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:01:12.743241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcc5e-aea0-4ed6-b761-d8f64225746d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:12.743882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcc5e-aea0-4ed6-b761-d8f64225746d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:12.743882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcc5e-aea0-4ed6-b761-d8f64225746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:12.765723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-87cdcc5e-aea0-4ed6-b761-d8f64225746d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:12.766934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-87cdcc5e-aea0-4ed6-b761-d8f64225746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:12.778059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1104/2213] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:12.795265 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:12.808978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fdfa-58c3-4cd6-a582-de16f3675eb5 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:12.821255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:12.821925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:12.822288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:12.822631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:12.833929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:12.834785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:12.846639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1110/2214] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:17.010922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefef8b-4797-4d8f-ac45-817bfbd51cc9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:17.011479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefef8b-4797-4d8f-ac45-817bfbd51cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:17.011479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefef8b-4797-4d8f-ac45-817bfbd51cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:17.022062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:17.040137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3eefef8b-4797-4d8f-ac45-817bfbd51cc9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:17.041650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3eefef8b-4797-4d8f-ac45-817bfbd51cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:17.075861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1105/2215] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:01:17.089731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:17.112713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee3f77-315d-43a3-bfd2-cc40bdb1db04 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:17.119973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:17.121565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:17.121841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:17.122119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:17.136020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:17.137718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e578e4-5b50-49e5-94a1-abfb5d311e9c service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:17.148450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1111/2216] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:25.090219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.090755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.090839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.092206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1106/2217] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 21:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 21:01:25.098795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe9cc-32d6-40e0-bfd6-d7e8f8c73605 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.099315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe9cc-32d6-40e0-bfd6-d7e8f8c73605 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.099431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fe9cc-32d6-40e0-bfd6-d7e8f8c73605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.122705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0e6fe9cc-32d6-40e0-bfd6-d7e8f8c73605 None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:25.125195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0e6fe9cc-32d6-40e0-bfd6-d7e8f8c73605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:25.142891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1112/2218] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:25.151528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:25.153328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:25.235073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d86cd-414e-45cc-a49a-0e06d80b3b6f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:25.243335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:25.244334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.244836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.245958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.258626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:25.260480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66546-1f7a-402d-ab52-a851ab876665 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:25.276564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1107/2219] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:01:25.350810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.351126 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.351404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] PATH_INFO: `/` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.352965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1113/2220] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 21:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:01:25.360673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0faba-dbdc-4ce1-980b-776987349d13 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.361174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0faba-dbdc-4ce1-980b-776987349d13 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.361454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0faba-dbdc-4ce1-980b-776987349d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.382879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-86b0faba-dbdc-4ce1-980b-776987349d13 None None] MFA Rules not processed for user `ffeab70f281f498cad508880727ca637`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:25.384147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-86b0faba-dbdc-4ce1-980b-776987349d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:25.443669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1108/2221] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:01:25.457501 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:25.459374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:25.475364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2dd78-78da-40d1-9814-bac6b9700b73 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:25.479927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:25.480553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.480832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.481108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.488913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:25.490380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4c6ee-376c-4595-b153-b034bd21306f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:25.499003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1114/2222] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:25.590716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b17d-a788-4a61-a489-6e1b1ee2d295 None None] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.591007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b17d-a788-4a61-a489-6e1b1ee2d295 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.591475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2b17d-a788-4a61-a489-6e1b1ee2d295 None None] PATH_INFO: `/` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.592897 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1109/2223] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 4 21:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 21:01:25.598071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b2c-9fc4-41e3-a82d-4bcad1699d0b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.598365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b2c-9fc4-41e3-a82d-4bcad1699d0b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.598643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea9b2c-9fc4-41e3-a82d-4bcad1699d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.620672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-81ea9b2c-9fc4-41e3-a82d-4bcad1699d0b None None] MFA Rules not processed for user `fff966e741314bb8b510713bff46a08c`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:25.622015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-81ea9b2c-9fc4-41e3-a82d-4bcad1699d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:25.648369 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1115/2224] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 4 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:25.655789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2b17d-a788-4a61-a489-6e1b1ee2d295 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:25.672009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2b17d-a788-4a61-a489-6e1b1ee2d295 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:25.679866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:25.680504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:25.680930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:25.681214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:25.701639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:25.703297 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:25.717616 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1110/2225] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:34.961107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3f19-30b7-4382-8f2e-419be49dd22c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:34.961615 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3f19-30b7-4382-8f2e-419be49dd22c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:34.961723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3f19-30b7-4382-8f2e-419be49dd22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:34.981240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7d6d3f19-30b7-4382-8f2e-419be49dd22c None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:34.982442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7d6d3f19-30b7-4382-8f2e-419be49dd22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:34.989623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1116/2226] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:35.012234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:35.023317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de962da-d5cc-420e-866e-bcb4667e548d service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:35.028803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:35.029401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:35.029679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:35.029949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:35.038270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:35.039881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:35.047694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1111/2227] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:01:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:01:37.866089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6575b57-0a00-4f60-a367-d1e4ab438318 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:37.866974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6575b57-0a00-4f60-a367-d1e4ab438318 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:37.866974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6575b57-0a00-4f60-a367-d1e4ab438318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:37.886060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d6575b57-0a00-4f60-a367-d1e4ab438318 None None] MFA Rules not processed for user `e5d45702098442ad87a92f3ccca8bc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:37.887297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d6575b57-0a00-4f60-a367-d1e4ab438318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:37.954859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1117/2228] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:45.044629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=63 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:46.808682 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:46.810138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:46.880566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4abdd1-8816-43e4-8117-ff7448aee82f service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:46.885768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:46.886442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:46.886752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:46.887034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:46.888912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:46.900504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:46.902130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:46.912228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1112/2229] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:01:47.942965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=61 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:01:54.301332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd40d5-e18d-4101-b1cd-9ea3f7566164 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:54.301879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd40d5-e18d-4101-b1cd-9ea3f7566164 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:54.301879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd40d5-e18d-4101-b1cd-9ea3f7566164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:54.321175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-58dd40d5-e18d-4101-b1cd-9ea3f7566164 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:01:54.323372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-58dd40d5-e18d-4101-b1cd-9ea3f7566164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:01:54.330572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1118/2230] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:01:54.343189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:01:54.354449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15b75-be1e-4fa4-8460-7f99544ef875 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:01:54.359363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:01:54.360080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:01:54.360366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:01:54.360644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:01:54.369142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:01:54.370778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:01:54.378987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1113/2231] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:02:00.904398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8c91-f537-4927-8e2f-05422ed3dd0c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:00.904947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8c91-f537-4927-8e2f-05422ed3dd0c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:00.904947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8c91-f537-4927-8e2f-05422ed3dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:00.925583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-947b8c91-f537-4927-8e2f-05422ed3dd0c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:00.926789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-947b8c91-f537-4927-8e2f-05422ed3dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:00.934769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1119/2232] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:02:00.949542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:00.961232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8ad59-dabf-4eff-9dea-318dbbf2534d service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:00.967121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:00.967721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:00.968032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:00.968310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:00.976413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:00.978515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:00.987799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1114/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:02:04.152257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582cf5-8340-45da-9bab-e154f66c244d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:04.152811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582cf5-8340-45da-9bab-e154f66c244d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:04.153120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582cf5-8340-45da-9bab-e154f66c244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:04.174082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-35582cf5-8340-45da-9bab-e154f66c244d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:04.175413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-35582cf5-8340-45da-9bab-e154f66c244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:04.183977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1120/2234] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:02:04.200090 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:04.211165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311811-1319-4f61-a9eb-4ce84edc2e55 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:04.218240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:04.218938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:04.219312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:04.219683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:04.228539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:04.230248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:04.240636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1115/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:02:08.289977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f453-3994-4481-ac8d-799b18b2a97a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:08.290542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f453-3994-4481-ac8d-799b18b2a97a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:08.290542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6f453-3994-4481-ac8d-799b18b2a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:08.316516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0de6f453-3994-4481-ac8d-799b18b2a97a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:08.317744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0de6f453-3994-4481-ac8d-799b18b2a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:08.327028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1121/2236] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:02:08.343327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:08.356716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e43262-5de5-460a-9359-1b06dd60d1fe service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:08.364418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:08.365037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:08.365533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:08.366303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:08.377522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:08.379500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:08.390697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1116/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:02:11.470563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798ce5-9b0a-4f47-8b2a-58c785acd3c9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:11.471042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798ce5-9b0a-4f47-8b2a-58c785acd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:11.471165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798ce5-9b0a-4f47-8b2a-58c785acd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:11.491497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fe798ce5-9b0a-4f47-8b2a-58c785acd3c9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:11.493358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fe798ce5-9b0a-4f47-8b2a-58c785acd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:11.501124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1122/2238] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:02:11.524141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:11.535733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98e2e-cc58-46b5-b8ef-d9c9e5b7d106 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:11.542018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:11.542699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:11.543063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:11.543402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:11.552511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:11.554136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:11.565590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1117/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:02:16.705892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22d9a5-8f82-4bc8-8c5a-c451f98fd4e8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:16.706433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22d9a5-8f82-4bc8-8c5a-c451f98fd4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:16.706543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22d9a5-8f82-4bc8-8c5a-c451f98fd4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:16.727106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5a22d9a5-8f82-4bc8-8c5a-c451f98fd4e8 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:16.728370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5a22d9a5-8f82-4bc8-8c5a-c451f98fd4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:16.736184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1123/2240] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Aug 4 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:02:16.755525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:16.761360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=63 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:16.767963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ed4e-b301-4348-92a0-fdf18e871116 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:16.774134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:16.774768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:16.775057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:16.775337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:16.784788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:16.786401 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc077808-e404-4d66-a74f-e44054cf990d service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:16.797244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1118/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:02:20.759365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:20.759902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:20.760016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:20.767116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=19 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:20.780315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] MFA Rules not processed for user `b23a317904864972b875257cfcd90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:20.781507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:20.788628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1124/2242] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:02:26.792461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:30.775531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:45.369239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:45.369819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:45.369819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:45.388937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] MFA Rules not processed for user `ab4b1b421a35490fa717ad21dc46eb97`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:45.390141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:45.398983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1119/2243] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:02:46.223984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:46.226529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:46.241548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab25de-bd40-4857-a93e-e29873e51bb5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:46.246134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:46.246842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:46.247119 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:46.247390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] PATH_INFO: `/v3/users/e5d45702098442ad87a92f3ccca8bc92` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:46.248632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d45702098442ad87a92f3ccca8bc92)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:46.250571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:46.300609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d45702098442ad87a92f3ccca8bc92'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.301599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d45702098442ad87a92f3ccca8bc92'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.311865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d45702098442ad87a92f3ccca8bc92'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.320149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d45702098442ad87a92f3ccca8bc92'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.332759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-112b78a3-8db7-4586-97de-a2dbb48483d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d45702098442ad87a92f3ccca8bc92'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.339297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1125/2244] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:02:46 2022] DELETE /identity/v3/users/e5d45702098442ad87a92f3ccca8bc92 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:02:46.533977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:02:46.553270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167648f-c338-4535-8da8-020b8cdc8e60 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:02:46.613114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:02:46.613755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:46.614035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:46.614306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] PATH_INFO: `/v3/projects/2fcedb795be940ee9db3e719e7926a18` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:46.615472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcedb795be940ee9db3e719e7926a18)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:02:46.617618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:02:46.666448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcedb795be940ee9db3e719e7926a18', 'request_id': 'req-dacf896c-c85e-44d0-870c-d2ea6967f022'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.673952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcedb795be940ee9db3e719e7926a18', 'request_id': 'req-dacf896c-c85e-44d0-870c-d2ea6967f022'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.680181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcedb795be940ee9db3e719e7926a18', 'request_id': 'req-dacf896c-c85e-44d0-870c-d2ea6967f022'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.693027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] The token cache is being invalidate because project 2fcedb795be940ee9db3e719e7926a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:02:46.693321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.693977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-dacf896c-c85e-44d0-870c-d2ea6967f022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:02:46.695785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1120/2245] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:02:46 2022] DELETE /identity/v3/projects/2fcedb795be940ee9db3e719e7926a18 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:02:46.790189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:02:46.790824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:02:46.791174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:02:46.814197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] MFA Rules not processed for user `236a8fb93bae48dd82086f1f35d1fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:02:46.814451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:02:46.894193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1126/2246] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:02:56.689607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:02:56.872575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:21.917377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:21.917947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:21.918226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:21.940877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] MFA Rules not processed for user `eb570550f73e4d6a8c87d2bc0c12b4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:21.943466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:22.015870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1121/2247] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:32.006766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=25 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:38.156558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:38.158032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:38.234064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b51940-909e-4df6-85c4-deebd3672ef5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:38.237840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:38.238514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:38.238965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:38.239393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:38.241426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:38.336837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:38.338284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd308ab-0951-4dbd-b883-02a2db7d2679 service glance] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:38.351480 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1127/2248] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:38.569402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:38.570814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:38.647149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f4a23-7192-481b-a87c-defa5739eedc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:38.656620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:38.657977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:38.658251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:38.658509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:38.661492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:38.677759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:38.679306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:38.690720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1122/2249] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:38.960725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:38.961013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:38.961287 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:38.979948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] MFA Rules not processed for user `b23a317904864972b875257cfcd90277`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:38.981125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:39.035145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1128/2250] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:48.685803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=26 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:49.028584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=79 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:51.088101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.089487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:51.103550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065e4ac-34cb-4b73-9b46-34e74f640c12 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.108928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.109524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.109806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.110076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.111721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:51.121618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:51.123247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410d373-4cc1-447a-ba8a-7cdf562b80f3 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:51.132116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1123/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:51.935888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:51.945876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c59ed-0bce-4d63-9615-073c9317795c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:51.949341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:51.949947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:51.950224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:51.950497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:51.952247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:52.018581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:52.020099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:52.030504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1129/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:52.911227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:52.911767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:52.911868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:52.930980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:52.932254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:52.991733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1124/2253] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:53.078195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:53.079764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:53.176549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3464-366e-459a-860f-7136bd43e9bc service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:53.184688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:53.186489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:53.187022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:53.187520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:53.213466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:53.217099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:53.240611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1130/2254] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:03:56.561137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.563083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:56.648436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:56.650642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:56.671074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b7d85-0fc7-4521-8fa7-ba85aadc869c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.693104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.694075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.694435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.694801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.695154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f9bc-e707-4c7b-9777-604474cc3bf3 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:56.697051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:56.702408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:56.703163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:56.703445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:56.703723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] PATH_INFO: `/v3/users/ab4b1b421a35490fa717ad21dc46eb97` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:56.705194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4b1b421a35490fa717ad21dc46eb97)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.707149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.712369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:56.714538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:56.735930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1125/2255] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:56.768484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4b1b421a35490fa717ad21dc46eb97'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:56.769264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4b1b421a35490fa717ad21dc46eb97'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:56.781488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4b1b421a35490fa717ad21dc46eb97'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:56.791452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4b1b421a35490fa717ad21dc46eb97'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:56.808410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:56.809909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-868d0c59-e7f2-4466-a7a0-209521902b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4b1b421a35490fa717ad21dc46eb97'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:56.819825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1131/2256] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:03:56 2022] DELETE /identity/v3/users/ab4b1b421a35490fa717ad21dc46eb97 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:57.017044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.031030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7b2f-5d72-43ab-b45c-3cd267c0e737 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.109779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.110534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.110820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.111153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] PATH_INFO: `/v3/projects/2d334c4e9d7744088bc546d5283bde27` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.112535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d334c4e9d7744088bc546d5283bde27)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.114800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.139638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.165956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d334c4e9d7744088bc546d5283bde27', 'request_id': 'req-ba4cd5b0-5d12-4546-9962-56ade58224e6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:57.184457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d334c4e9d7744088bc546d5283bde27', 'request_id': 'req-ba4cd5b0-5d12-4546-9962-56ade58224e6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:57.191737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d334c4e9d7744088bc546d5283bde27', 'request_id': 'req-ba4cd5b0-5d12-4546-9962-56ade58224e6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:57.203895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] The token cache is being invalidate because project 2d334c4e9d7744088bc546d5283bde27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:03:57.204207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:57.204898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ba4cd5b0-5d12-4546-9962-56ade58224e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:57.207055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1126/2257] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:03:57 2022] DELETE /identity/v3/projects/2d334c4e9d7744088bc546d5283bde27 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:57.212420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.212820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.213362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.240463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:57.242552 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:57.343594 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1132/2258] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:03:57.351649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.351878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.352139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.375661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:57.376929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:57.389396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1127/2259] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:57.390591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.411784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6caf4-f313-4931-861c-ddd563eaeef0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.418879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.419520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.419827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.420131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.420846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:03:57.421163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.423403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.437150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1133/2260] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:03:57.443588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.453590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1846-f476-4d89-96a6-ebe2f565ff4c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.460504 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.461793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.462323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.462658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.466363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.469057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.508751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1128/2261] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/projects => generated 405 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:57.512579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.527290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86403b62-043f-4069-a7e2-581f3dc493cc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.596948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.597910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.598217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.598571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.599277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.601506 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.630650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1134/2262] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:57.631788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.645592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e5e7-2022-406e-86ec-7baa2320163f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.650669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.651293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.651574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.651891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.652687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.654275 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.667702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1129/2263] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:03:57.671943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.684468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e246-cc21-4eac-a7bd-482f716e9ebd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.689445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.690062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.691886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.691886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.692085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.694939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bf4be-ad84-402e-a6e5-f8b6552cad5b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.714535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1135/2264] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:03:57.716013 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:57.731161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b49d6-c878-49ab-a09e-d8416c3ff02a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:57.737507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:57.738152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.738572 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.739412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] PATH_INFO: `/v3/projects/5d203002748541d286c7078af3b0bf32/users/3708644d83cf40eb8b6a48d50be5a421/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.759377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d203002748541d286c7078af3b0bf32, user_id=3708644d83cf40eb8b6a48d50be5a421, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:57.762108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:57.800005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1130/2265] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:03:57 2022] PUT /identity/v3/projects/5d203002748541d286c7078af3b0bf32/users/3708644d83cf40eb8b6a48d50be5a421/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:03:57.807676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:57.808060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:57.808409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:57.844996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] MFA Rules not processed for user `3708644d83cf40eb8b6a48d50be5a421`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:57.846303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:57.923358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:57.955433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1136/2266] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:57.961048 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.035531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852de63-fa91-40a1-9667-ef25582d5fd0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.041969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.043098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.043382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.043730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.044440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.046416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.082146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1131/2267] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:03:57 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:58.088546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.099555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12549-eb1e-40d2-8066-d773798b6c6d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.177946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.178744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.179215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.179558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.180351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.182374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.207277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1137/2268] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:03:58 2022] POST /identity/v3/users => generated 307 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:03:58.212108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.223100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7f8af-ba30-41b2-907c-6209e828e2af admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.233475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.234131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.234418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.234790 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.235509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.237323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.251517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1132/2269] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:03:58.254986 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.265896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2120-ea25-41c9-a319-a66156b012ba admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.273757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.274686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.275048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.275396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] PATH_INFO: `/v3/projects/97a9556eaffe4e05b66129536d651279/users/7352d72ac1dc4a9ca9df958038b27ccc/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.299132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a9556eaffe4e05b66129536d651279, user_id=7352d72ac1dc4a9ca9df958038b27ccc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.302365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.319046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1138/2270] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:03:58 2022] PUT /identity/v3/projects/97a9556eaffe4e05b66129536d651279/users/7352d72ac1dc4a9ca9df958038b27ccc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:58.322797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.334952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f53be-907f-4a48-a91f-7669fd527f0c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.358206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:58.405822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.406450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.406735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.407016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.407722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.409414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267feec8-1ba2-4341-8374-c5ad183156f0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.434397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1133/2271] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:03:58.438624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.450049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6c22-7bd4-4f61-898d-2333e407fa7a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.457485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.457485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.457485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.457485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] PATH_INFO: `/v3/projects/97a9556eaffe4e05b66129536d651279/users/7352d72ac1dc4a9ca9df958038b27ccc/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.459410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a9556eaffe4e05b66129536d651279, user_id=7352d72ac1dc4a9ca9df958038b27ccc, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.462304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.475796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1139/2272] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:03:58 2022] PUT /identity/v3/projects/97a9556eaffe4e05b66129536d651279/users/7352d72ac1dc4a9ca9df958038b27ccc/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:03:58.486081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.486380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.486660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.519932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] MFA Rules not processed for user `7352d72ac1dc4a9ca9df958038b27ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:58.521176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:58.609448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1134/2273] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:58.620831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.622745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:58.693639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f6f5-1638-4fba-b9c0-681dbb9e436b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.698510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.699142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.699425 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.699703 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.710231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.711689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400d9a-7797-411f-8d64-44b1899f53f7 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:58.723047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1140/2274] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:03:58.878617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:58.983640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027298b3-f980-4699-bc92-fc4a618cd0c1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:58.993135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:58.993737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:58.994022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:58.994305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] PATH_INFO: `/v3/users/3708644d83cf40eb8b6a48d50be5a421` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:58.995522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3708644d83cf40eb8b6a48d50be5a421)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:58.997981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.080913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.086243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3708644d83cf40eb8b6a48d50be5a421'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.088711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3708644d83cf40eb8b6a48d50be5a421'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.099763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3708644d83cf40eb8b6a48d50be5a421'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.111239 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3708644d83cf40eb8b6a48d50be5a421'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.112858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3708644d83cf40eb8b6a48d50be5a421'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.152967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1135/2275] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:03:58 2022] DELETE /identity/v3/users/3708644d83cf40eb8b6a48d50be5a421 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:59.158164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.158558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.159502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.184014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:03:59.185249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:59.240903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:03:59.264210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1141/2276] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:03:59.276927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.278767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:59.347695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b9c37-f2be-41ff-98b7-d59944325773 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.351313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.351985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.355081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.355081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.363319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.364824 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.378003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1136/2277] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:03:59.769405 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.771402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:03:59.785457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666d65-e32a-4c2f-a89e-417289c94f2d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:03:59.790522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:03:59.791325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:03:59.791871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:03:59.792228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] PATH_INFO: `/v3/projects/5d203002748541d286c7078af3b0bf32` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:03:59.793572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d203002748541d286c7078af3b0bf32)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:03:59.795631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:03:59.919948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d203002748541d286c7078af3b0bf32', 'request_id': 'req-2ecfd055-973a-41f5-a7d6-f6e8560393aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.930698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d203002748541d286c7078af3b0bf32', 'request_id': 'req-2ecfd055-973a-41f5-a7d6-f6e8560393aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.937120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d203002748541d286c7078af3b0bf32', 'request_id': 'req-2ecfd055-973a-41f5-a7d6-f6e8560393aa'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.953906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] The token cache is being invalidate because project 5d203002748541d286c7078af3b0bf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:03:59.954254 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.954923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:03:59.960077 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1142/2278] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:03:59 2022] DELETE /identity/v3/projects/5d203002748541d286c7078af3b0bf32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:03:59.963766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:03:59.977898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fe4a4-ad5f-4085-b5ca-edb584fadd3a service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.048330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.049144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.050081 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.050666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] PATH_INFO: `/v3/users/7352d72ac1dc4a9ca9df958038b27ccc` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.052056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7352d72ac1dc4a9ca9df958038b27ccc)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.054055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.106279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7352d72ac1dc4a9ca9df958038b27ccc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.107112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7352d72ac1dc4a9ca9df958038b27ccc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.115786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7352d72ac1dc4a9ca9df958038b27ccc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.124126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7352d72ac1dc4a9ca9df958038b27ccc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.124895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-842ab280-0884-4790-9733-ed6f3a34a5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7352d72ac1dc4a9ca9df958038b27ccc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.135855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.159174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1137/2279] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:03:59 2022] DELETE /identity/v3/users/7352d72ac1dc4a9ca9df958038b27ccc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:00.557519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.559230 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:00.592744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd055-973a-41f5-a7d6-f6e8560393aa admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.660854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.661917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.662359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.662630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] PATH_INFO: `/v3/projects/97a9556eaffe4e05b66129536d651279` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.664106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a9556eaffe4e05b66129536d651279)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.666018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.726393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a9556eaffe4e05b66129536d651279', 'request_id': 'req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.735642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a9556eaffe4e05b66129536d651279', 'request_id': 'req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.745210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a9556eaffe4e05b66129536d651279', 'request_id': 'req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.753913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:00.758231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] The token cache is being invalidate because project 97a9556eaffe4e05b66129536d651279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:00.758882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.760354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-59c6ba2d-4ec6-4c1e-b1a5-d7967d6db6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:00.764323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1143/2280] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:00 2022] DELETE /identity/v3/projects/97a9556eaffe4e05b66129536d651279 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:00.770720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.771121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.771340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.794988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:00.796336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:00.874075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1138/2281] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:00.875662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.876365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.876656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.901700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:00.903066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:00.912113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1144/2282] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:00.920150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.932770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1d136-d007-47e4-88c9-ba07e49eb548 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.942901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.943535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.943847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.944135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.944847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:00.945156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.947421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:00.962677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1139/2283] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:00.966788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:00.983383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274afd8-4189-44a9-8038-3154d33a16b9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:00.989941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:00.990641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:00.991007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:00.991333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:00.992133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:00.994151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.028541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1145/2284] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:00 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:01.035457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.047150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d79b78-4521-4044-83e1-72117f264ba9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.117355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.118052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.118614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.118985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.119672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.121661 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.147022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1140/2285] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:01.151323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.164891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be89ce-c983-4a7d-bd01-fa50a99eb54b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.169824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.170620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.171161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.171588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.172474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.174519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.189766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1146/2286] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:01.194835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.205625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59806bb-525c-42e6-b8fc-b4bb59220599 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.214821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.215463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.215774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.216199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.216909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.218686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8662cc6-e91e-4d56-a753-580cc1576cad admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.237507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1141/2287] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:01.241706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.252736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3163d-4a88-48f5-9764-1a834d4bd031 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.258224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.259123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.259583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.260056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] PATH_INFO: `/v3/projects/be7013a23656444a98eaed298d8d0ae6/users/6ca95f49fb31436aa2124f3c14bb3931/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.275795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7013a23656444a98eaed298d8d0ae6, user_id=6ca95f49fb31436aa2124f3c14bb3931, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.278457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.295560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1147/2288] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:01 2022] PUT /identity/v3/projects/be7013a23656444a98eaed298d8d0ae6/users/6ca95f49fb31436aa2124f3c14bb3931/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:01.309374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.309781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.310211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.344523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] MFA Rules not processed for user `6ca95f49fb31436aa2124f3c14bb3931`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:01.347783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:01.396007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:01.430976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1142/2289] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:01.432439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.522564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34c217-9f3c-4643-9f01-d3f825541a10 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.529990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.530991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.531295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.531664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.532432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.534716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.570953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1148/2290] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:01.574950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.588268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacca96-399a-4c4c-b698-e6175ded7d4f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.658868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.659536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.659846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.660122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.660805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.662916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.690645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1143/2291] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:01.694512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.705818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c3f45-e662-4daa-a253-311fa2475044 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.711015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312948-aa18-4176-9370-70953087c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.711712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312948-aa18-4176-9370-70953087c152 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.712448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312948-aa18-4176-9370-70953087c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.712785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312948-aa18-4176-9370-70953087c152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.713684 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312948-aa18-4176-9370-70953087c152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.715502 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312948-aa18-4176-9370-70953087c152 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.732228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1149/2292] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:01.736162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.753284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc361ce-24ae-4d9f-ba13-ae4192363ce7 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.758094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.758867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.759220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.759785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] PATH_INFO: `/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204/users/0ab81157a81e4388a27d2195f7f240a2/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.778561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9fbf6b7d32499382b2fed0cb5ed204, user_id=0ab81157a81e4388a27d2195f7f240a2, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.781618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.798389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1144/2293] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:01 2022] PUT /identity/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204/users/0ab81157a81e4388a27d2195f7f240a2/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:01.804146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312948-aa18-4176-9370-70953087c152 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.816058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312948-aa18-4176-9370-70953087c152 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.881146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.881842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.882384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.882740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.883493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.885187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaae3aa-d902-4202-99ca-16b9e7f64dcc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.896817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1150/2294] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:01.900835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:01.918341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac822f2-11a9-4566-bc5f-13be1a3fdd9f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:01.923276 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:01.924104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.924983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.925265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] PATH_INFO: `/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204/users/0ab81157a81e4388a27d2195f7f240a2/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.930966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9fbf6b7d32499382b2fed0cb5ed204, user_id=0ab81157a81e4388a27d2195f7f240a2, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:01.934326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:01.953456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1145/2295] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:01 2022] PUT /identity/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204/users/0ab81157a81e4388a27d2195f7f240a2/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:01.962872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:01.963277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:01.963642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:01.980760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:02.001550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] MFA Rules not processed for user `0ab81157a81e4388a27d2195f7f240a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:02.003030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:02.094538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1151/2296] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:02.107094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.108843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:02.180941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6393-4115-4cc9-b9b6-5680b7e21182 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.187366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.188037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.188318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.188598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.199181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.200795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:02.212477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1146/2297] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:02.300648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:02.312906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a04f7-23aa-4a1f-9311-58e5f231aad4 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:02.316958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:02.317917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:02.318428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:02.318854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:02.394071 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:02.395805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:02.409253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1152/2298] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:03.361303 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:03.362821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:03.402457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:03.421408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef691-bec7-4f75-a431-b594ceda52f0 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:03.425101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:03.425724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:03.426007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:03.426282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:03.428061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:03.494311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:03.495785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d571f-6757-4c71-834d-77fda1a334e8 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:03.504946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1147/2299] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:08.454479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.529195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c97f2f8-7bad-450c-97c7-ed4f02fc16fc service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.534683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.535403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.535764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.536120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] PATH_INFO: `/v3/users/6ca95f49fb31436aa2124f3c14bb3931` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.537364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca95f49fb31436aa2124f3c14bb3931)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.539516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.577779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:08.591256 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca95f49fb31436aa2124f3c14bb3931'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:08.591945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca95f49fb31436aa2124f3c14bb3931'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:08.600772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca95f49fb31436aa2124f3c14bb3931'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:08.608807 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca95f49fb31436aa2124f3c14bb3931'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:08.624493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca95f49fb31436aa2124f3c14bb3931'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:08.631696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1153/2300] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:08 2022] DELETE /identity/v3/users/6ca95f49fb31436aa2124f3c14bb3931 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:08.636280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.636743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.636839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.656760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:08.658248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:08.692447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.694069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:08.723082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1148/2301] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:08.733107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:08.734489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:08.764477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd665b1-339e-4975-aa1b-96c04d0091d8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.770130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.770746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.771025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.771297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.773373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:08.786170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.787775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.790940 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf594572-28d2-444e-9afe-dcb8e23f3deb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:08.794711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:08.795328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:08.795613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:08.795932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:08.797901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1154/2302] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:08.805589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:08.807991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:08.818595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1149/2303] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:09.109691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:09.118397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:09.137338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df51a0-7756-485b-9a5f-78dd6df01758 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:09.142922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.143723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.144137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.144998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] PATH_INFO: `/v3/projects/be7013a23656444a98eaed298d8d0ae6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.146485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7013a23656444a98eaed298d8d0ae6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.148493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.211600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7013a23656444a98eaed298d8d0ae6', 'request_id': 'req-0714d7e1-1d6a-4311-bcb7-790349a9312a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.220481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7013a23656444a98eaed298d8d0ae6', 'request_id': 'req-0714d7e1-1d6a-4311-bcb7-790349a9312a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.227238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7013a23656444a98eaed298d8d0ae6', 'request_id': 'req-0714d7e1-1d6a-4311-bcb7-790349a9312a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.241837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] The token cache is being invalidate because project be7013a23656444a98eaed298d8d0ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:09.242133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.242763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.244323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1155/2304] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:09 2022] DELETE /identity/v3/projects/be7013a23656444a98eaed298d8d0ae6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:09.248424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:09.258458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57bb8d-28ae-448a-b46a-1db459d16fde service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:09.292054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:09.324399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.325140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.325419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.325695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] PATH_INFO: `/v3/users/0ab81157a81e4388a27d2195f7f240a2` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.326857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab81157a81e4388a27d2195f7f240a2)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.328862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.382059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab81157a81e4388a27d2195f7f240a2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.382673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab81157a81e4388a27d2195f7f240a2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.389622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab81157a81e4388a27d2195f7f240a2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.397454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab81157a81e4388a27d2195f7f240a2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.398215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-57735a12-3720-4cea-93cd-42f766aebea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab81157a81e4388a27d2195f7f240a2'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.415952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1150/2305] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:09 2022] DELETE /identity/v3/users/0ab81157a81e4388a27d2195f7f240a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:09.725634 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:09.727140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:09.742492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714d7e1-1d6a-4311-bcb7-790349a9312a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:09.781648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:09.833024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:09.833675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.833955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.834250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] PATH_INFO: `/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.835592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9fbf6b7d32499382b2fed0cb5ed204)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:09.837730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:09.899045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9fbf6b7d32499382b2fed0cb5ed204', 'request_id': 'req-3c6c53e4-3941-4787-92cb-3ca3353bf098'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.907342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9fbf6b7d32499382b2fed0cb5ed204', 'request_id': 'req-3c6c53e4-3941-4787-92cb-3ca3353bf098'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.913712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9fbf6b7d32499382b2fed0cb5ed204', 'request_id': 'req-3c6c53e4-3941-4787-92cb-3ca3353bf098'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.927164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] The token cache is being invalidate because project cc9fbf6b7d32499382b2fed0cb5ed204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:09.927784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.929424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3c6c53e4-3941-4787-92cb-3ca3353bf098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:09.931417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1156/2306] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:09 2022] DELETE /identity/v3/projects/cc9fbf6b7d32499382b2fed0cb5ed204 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:09.937159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:09.937977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:09.938415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:09.966253 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:09.972650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:10.042402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1151/2307] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:10.051588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.051909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.052264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.073045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:10.074258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:10.082558 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1157/2308] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:10.086814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.100406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310acc-8552-43ae-b330-0d94c809b388 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.105197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.105832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.106115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.106397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.107111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:10.107432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.109240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.122674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1152/2309] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:10.127659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.137232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71685233-f7fb-4b82-b182-18c1e723395e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.142182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.142961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.143236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.143514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.144224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.147058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.178750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1158/2310] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:10.182950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.196620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911c23c-6dd7-4a8c-810f-1eee0cfd5279 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.237841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:10.258693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.259306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.259584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.259901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.260640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.262607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.289002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1153/2311] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:10.294183 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.314322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0628c-ffa7-4d96-9b21-4a1f4bc8cc1e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.323135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.325064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.325589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.326097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.327565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.330664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.350836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1159/2312] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:10.353065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.367473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109df7-c2d4-481b-b5d7-b7ff49522944 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.372786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.373472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.373755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.374033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.374740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.376664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe264be-e22b-41b1-8bfe-1d8c54e028e9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.392062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1154/2313] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:10.396547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.406819 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caafba-79ad-4ff8-bf0d-273d180df39a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.411891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.412537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.412814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.413086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] PATH_INFO: `/v3/projects/b8173471276b459f8a0d1409f1c526a5/users/35f673147fc44e26942330fc3b17a7a0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.427877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8173471276b459f8a0d1409f1c526a5, user_id=35f673147fc44e26942330fc3b17a7a0, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.430497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87309f9d-a914-4d83-84ef-6969b02daa88 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.443161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1160/2314] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:10 2022] PUT /identity/v3/projects/b8173471276b459f8a0d1409f1c526a5/users/35f673147fc44e26942330fc3b17a7a0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:10.454426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.454719 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.455019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.485498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] MFA Rules not processed for user `35f673147fc44e26942330fc3b17a7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:10.487371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:10.556357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1155/2315] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:10.559760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.560070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.560345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.560721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.580011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:10.581488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:10.622000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61b19-8c77-4834-92eb-3b046f862307 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.626852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.627486 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.627845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.628066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.628226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:10.628735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.630753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.641438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1161/2316] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:10.653517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.654860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:10.660693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1156/2317] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:10.664582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.698823 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:10.724353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36a75-219d-44da-bc9c-9657b404c784 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.727989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde29c3-fa9e-4d67-acae-a524e47c5451 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.733271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.733887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.734165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.734438 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.735101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.737068 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.759515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1157/2318] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:10 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:10.763430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.773550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228220a-5bc3-4732-b3b8-b40c0ca3f33e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.778151 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.778754 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.779040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.779320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.780053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.782029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.785419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.786048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.786329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.786602 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.792249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1158/2319] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:10.796225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.806856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c1714-9426-41cf-9986-8407fa6cf4d5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.812343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.813033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.813318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.813595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] PATH_INFO: `/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8/users/558dd5ec2d7749dba93f28c563ff700f/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.829427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea83f1b860b347ea9c192e1f8483d1d8, user_id=558dd5ec2d7749dba93f28c563ff700f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.832247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.845345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1159/2320] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:10 2022] PUT /identity/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8/users/558dd5ec2d7749dba93f28c563ff700f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:10.846015 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.847716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.849386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:10.856287 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1162/2321] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:10.937606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96251a-eb6e-448e-9dd0-67598a09a796 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:10.951065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:10.951891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:10.952245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:10.952631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:10.953428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:10.957330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5131ae-b019-4335-932a-9b3d2ea4fda8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:10.980351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1160/2322] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:10.984923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.013919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54fcdc-5d03-421e-855b-4d809593b7fe service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.029266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.030340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.030633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.030908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] PATH_INFO: `/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8/users/558dd5ec2d7749dba93f28c563ff700f/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.037105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea83f1b860b347ea9c192e1f8483d1d8, user_id=558dd5ec2d7749dba93f28c563ff700f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:11.040538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:11.058216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1163/2323] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:10 2022] PUT /identity/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8/users/558dd5ec2d7749dba93f28c563ff700f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:11.068610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.069197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.070083 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.121082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] MFA Rules not processed for user `558dd5ec2d7749dba93f28c563ff700f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:11.122509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:11.236502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1161/2324] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:11.249268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.251141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:11.290452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.332994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda99826-0fe8-4db5-b45f-038fd8815d13 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.336838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.337466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.337754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.338027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.350607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:11.352459 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:11.363163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1164/2325] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:11.515092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:11.527278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cbce7-2eb1-4f22-9677-5b34dc798690 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:11.531445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:11.532113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:11.532402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:11.532707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:11.538623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:11.591594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:11.593291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581615-719c-4a52-8fe0-6be81feb2c05 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:11.603581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1162/2326] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:14.259422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:14.353089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257d81-8212-4b3a-8148-78864b92483f service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:14.357816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:14.358544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.358829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.359104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] PATH_INFO: `/v3/users/35f673147fc44e26942330fc3b17a7a0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.360332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f673147fc44e26942330fc3b17a7a0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:14.362847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:14.419302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f673147fc44e26942330fc3b17a7a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:14.420277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f673147fc44e26942330fc3b17a7a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:14.430491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f673147fc44e26942330fc3b17a7a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:14.438719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f673147fc44e26942330fc3b17a7a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:14.451118 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f673147fc44e26942330fc3b17a7a0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:14.457510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1165/2327] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:14 2022] DELETE /identity/v3/users/35f673147fc44e26942330fc3b17a7a0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:14.461939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.462415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.462724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.483266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:14.484506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:14.547120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1163/2328] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:14.560632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:14.565985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:14.632988 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:14.640423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43c0c-4d4e-4f2b-b3c5-b99d6fe32be2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:14.645160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:14.646111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:14.646493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:14.646866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:14.657666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:14.660009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:14.672912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1166/2329] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:14.992394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:14.993813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.007019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866c721-8c87-4d8c-8962-824ffe57419c None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.011639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.012316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.012602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.012864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] PATH_INFO: `/v3/projects/b8173471276b459f8a0d1409f1c526a5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.014021 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8173471276b459f8a0d1409f1c526a5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.015979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:15.084436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8173471276b459f8a0d1409f1c526a5', 'request_id': 'req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.093652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8173471276b459f8a0d1409f1c526a5', 'request_id': 'req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.100072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8173471276b459f8a0d1409f1c526a5', 'request_id': 'req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.112292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] The token cache is being invalidate because project b8173471276b459f8a0d1409f1c526a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:15.112586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.113310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.114970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1164/2330] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:14 2022] DELETE /identity/v3/projects/b8173471276b459f8a0d1409f1c526a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:15.119087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.129723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db6683-6ea4-4522-bb65-7409447cd3bf service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.196989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.197633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.197911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.198182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] PATH_INFO: `/v3/users/558dd5ec2d7749dba93f28c563ff700f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.199363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=558dd5ec2d7749dba93f28c563ff700f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.201395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:15.255149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558dd5ec2d7749dba93f28c563ff700f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.255830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558dd5ec2d7749dba93f28c563ff700f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.266117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558dd5ec2d7749dba93f28c563ff700f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.276101 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558dd5ec2d7749dba93f28c563ff700f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.288762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2298d718-8bc6-44af-b679-345ac1acd12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558dd5ec2d7749dba93f28c563ff700f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.294977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1167/2331] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:15 2022] DELETE /identity/v3/users/558dd5ec2d7749dba93f28c563ff700f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:15.569289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.570862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.585174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e7daa-5e2a-4da0-9b4b-4177324a0c7f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.624928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:15.660441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.661096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.661382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.661685 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] PATH_INFO: `/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.662859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea83f1b860b347ea9c192e1f8483d1d8)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.664831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:15.722055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea83f1b860b347ea9c192e1f8483d1d8', 'request_id': 'req-83dee892-eb6b-4d49-a9c5-8da09918ffe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.731358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea83f1b860b347ea9c192e1f8483d1d8', 'request_id': 'req-83dee892-eb6b-4d49-a9c5-8da09918ffe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.741023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea83f1b860b347ea9c192e1f8483d1d8', 'request_id': 'req-83dee892-eb6b-4d49-a9c5-8da09918ffe7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.756951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] The token cache is being invalidate because project ea83f1b860b347ea9c192e1f8483d1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:15.757383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.757950 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-83dee892-eb6b-4d49-a9c5-8da09918ffe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:15.759895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1165/2332] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:15 2022] DELETE /identity/v3/projects/ea83f1b860b347ea9c192e1f8483d1d8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:15.764508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.764870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.765216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.785908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:15.787214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.879823 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1168/2333] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:15.884402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.884734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.885028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.911107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:15.912725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:15.924629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1166/2334] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:15.925576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.935998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec76f55-a001-48f4-bddc-856afcc4ce4c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.942607 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.943550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.944092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.944592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.945600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:15.946133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.948259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:15.951174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:15.966352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1169/2335] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:15.967393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:15.976603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361247c-19bb-4e6d-a566-24ba1aa03edc None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:15.981307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:15.981918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:15.982198 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:15.982476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:15.983149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:15.985109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.016234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1167/2336] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:15 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:16.021756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.032945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f948-a2aa-467a-9a7a-f40576b72ed8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.095768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.096402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.096708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.097049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.097736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.099645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.122724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1170/2337] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:16 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:16.127523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.138446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4409eb6-6412-43ae-9ad3-da1ed888dcd3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.143364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.144026 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.144312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.144593 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.145301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.146951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.157553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1168/2338] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:16.161652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.171647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d281-3c26-492c-af72-f4a26a0bbb84 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.176944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.177600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.177875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.178146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.178830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.180457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba750e2a-dc42-4b6a-87f1-00281cfd8711 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.202403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1171/2339] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:16.206368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.217636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506b8b8-551a-479c-887b-1d13ffcfe293 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.222973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.223809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.224099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.224384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] PATH_INFO: `/v3/projects/47d8ae9c3bce497bbb50d83d51ea0f0e/users/6a30e0e4a1674b2482130dafb7fa10c0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.243294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d8ae9c3bce497bbb50d83d51ea0f0e, user_id=6a30e0e4a1674b2482130dafb7fa10c0, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.245970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.259137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1169/2340] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:16 2022] PUT /identity/v3/projects/47d8ae9c3bce497bbb50d83d51ea0f0e/users/6a30e0e4a1674b2482130dafb7fa10c0/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:16.270313 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.270825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.270932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.301782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] MFA Rules not processed for user `6a30e0e4a1674b2482130dafb7fa10c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:16.303037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:16.385041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1172/2341] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:16.391604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.469203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.473865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a50e8-e2cd-4aeb-879d-1e8d65134a41 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.480511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.481383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.482011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.482462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.483143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.485181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.511771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1170/2342] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:16 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:16.515907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.526519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b6598-6190-47a8-a371-6efdb576bbc1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.590238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.590995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.591400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.591849 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.592542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.594693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.605644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:16.623408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1173/2343] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:16 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:16.624294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.634845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7157-ad72-47aa-9fc8-4d37da84a033 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.639514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.640170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.640459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.640731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.641526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.643095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.654806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1171/2344] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:16.660315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.677150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a38a7a-16f5-483f-94d5-bc9395c357e6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.684691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.685739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.686216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.686668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] PATH_INFO: `/v3/projects/fae6e48112664411928c757360038939/users/285d741eb5eb4980a1562a4f22b14f13/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.710669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae6e48112664411928c757360038939, user_id=285d741eb5eb4980a1562a4f22b14f13, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.715569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.731387 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1174/2345] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:16 2022] PUT /identity/v3/projects/fae6e48112664411928c757360038939/users/285d741eb5eb4980a1562a4f22b14f13/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:16.735377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.749656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ee68-2492-4f69-a679-1c5b5b81b26c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.810740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.811358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.811641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.811946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.812639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.814306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb84fe-3128-4c3a-940c-1108c35b9248 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.824173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1172/2346] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:16.828326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:16.839247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771165d9-574e-47d5-a3b9-41c14b8099b6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:16.844109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:16.844818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.845194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.846176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] PATH_INFO: `/v3/projects/fae6e48112664411928c757360038939/users/285d741eb5eb4980a1562a4f22b14f13/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.848257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae6e48112664411928c757360038939, user_id=285d741eb5eb4980a1562a4f22b14f13, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:16.850915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:16.862028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1175/2347] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:16 2022] PUT /identity/v3/projects/fae6e48112664411928c757360038939/users/285d741eb5eb4980a1562a4f22b14f13/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:16.873512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:16.873859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:16.874084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:16.906086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] MFA Rules not processed for user `285d741eb5eb4980a1562a4f22b14f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:16.907305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:16.999244 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1173/2348] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:17.010720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:17.012808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:17.094309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5bc9-4960-40ff-a2b1-dce896ed1f08 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:17.099190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:17.099993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:17.100435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:17.100896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:17.171507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:17.172975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:17.183894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1176/2349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:21.511812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.513313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:21.514475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:21.515808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:21.526750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b72be-6d48-4500-bc81-c08e25416643 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.530730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.531339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.531624 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.531943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.541247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.542740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.553203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1177/2350] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:21.568620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:21.589907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5585a-6f80-4b51-9561-90ead8d33434 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:21.595516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:21.596172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:21.596976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:21.597260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:21.599388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:21.657800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:21.659978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f31dac-493c-47a3-94c9-851ce18a6f91 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:21.669246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1174/2351] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:24.673826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:24.676024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:24.734702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a078e0-9bad-406c-ad8e-b2d4c7a64bc1 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:24.740059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:24.740686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:24.740970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:24.741244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:24.743013 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:24.752902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:24.754718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:24.759331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:24.764093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1178/2352] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:26.461904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.462447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.462625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.489079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.503448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:26.504699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:26.574803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ceb60-edbd-4e30-b347-add06d14f37b service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.581557 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.582381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.583511 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.584128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] PATH_INFO: `/v3/users/6a30e0e4a1674b2482130dafb7fa10c0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.585158 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1175/2353] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:26.585786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a30e0e4a1674b2482130dafb7fa10c0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.588907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.606930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.609339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:26.671952 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a30e0e4a1674b2482130dafb7fa10c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:26.672780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a30e0e4a1674b2482130dafb7fa10c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:26.681281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a30e0e4a1674b2482130dafb7fa10c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:26.690904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a30e0e4a1674b2482130dafb7fa10c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:26.706393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-96c34cfe-3080-45dc-ae46-b1fa631f9ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a30e0e4a1674b2482130dafb7fa10c0'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:26.717388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904ca55-1990-42c2-bad8-c4f9b5dae7f2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.719398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1179/2354] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:26 2022] DELETE /identity/v3/users/6a30e0e4a1674b2482130dafb7fa10c0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:26.732196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.732196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.732196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.750754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:26.752086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:26.757476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:26.788666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.789413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.789831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.790220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.792254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:26.827292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1180/2355] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:26.838517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:26.840045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:26.858692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.860380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.867269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:26.868827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1176/2356] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:04:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 21:04:26.914390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e213c-c192-414b-b7ef-4b971a70988f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:26.919728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:26.920393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:26.920681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:26.920968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:26.931134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:26.932716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:26.945141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1181/2357] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:27.242744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:27.244492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:27.266110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3ca41-1127-40c9-8155-486a1b4e75e2 service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:27.271288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:27.271984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.272273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.272536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] PATH_INFO: `/v3/projects/47d8ae9c3bce497bbb50d83d51ea0f0e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.273729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d8ae9c3bce497bbb50d83d51ea0f0e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:27.276161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:27.339809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d8ae9c3bce497bbb50d83d51ea0f0e', 'request_id': 'req-54246f43-e239-4c7e-8773-f1f93d5bee15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.347522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d8ae9c3bce497bbb50d83d51ea0f0e', 'request_id': 'req-54246f43-e239-4c7e-8773-f1f93d5bee15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.353495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d8ae9c3bce497bbb50d83d51ea0f0e', 'request_id': 'req-54246f43-e239-4c7e-8773-f1f93d5bee15'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.367866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] The token cache is being invalidate because project 47d8ae9c3bce497bbb50d83d51ea0f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:27.368159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.368836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.370431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1177/2358] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:27 2022] DELETE /identity/v3/projects/47d8ae9c3bce497bbb50d83d51ea0f0e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:27.374396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:27.391168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69ba1-fa94-4f69-b52b-84f5a6cb49c9 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:27.461064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:27.461616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.461890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.462161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] PATH_INFO: `/v3/users/285d741eb5eb4980a1562a4f22b14f13` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.463335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=285d741eb5eb4980a1562a4f22b14f13)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:27.465401 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:27.512426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285d741eb5eb4980a1562a4f22b14f13'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.513096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285d741eb5eb4980a1562a4f22b14f13'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.520734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285d741eb5eb4980a1562a4f22b14f13'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.527886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285d741eb5eb4980a1562a4f22b14f13'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.540042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c1e1a6b3-7ca4-41fa-9fbf-38c109b6be1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285d741eb5eb4980a1562a4f22b14f13'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:27.547132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1182/2359] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:27 2022] DELETE /identity/v3/users/285d741eb5eb4980a1562a4f22b14f13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:27.906372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:27.907882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:27.921658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54246f43-e239-4c7e-8773-f1f93d5bee15 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:27.983614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:27.984215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:27.984499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:27.984776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] PATH_INFO: `/v3/projects/fae6e48112664411928c757360038939` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:27.986033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae6e48112664411928c757360038939)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:27.988718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:27.991508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.039104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae6e48112664411928c757360038939', 'request_id': 'req-9700d5f4-273e-4517-9cb4-27c95fc747f1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.046686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae6e48112664411928c757360038939', 'request_id': 'req-9700d5f4-273e-4517-9cb4-27c95fc747f1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.052420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae6e48112664411928c757360038939', 'request_id': 'req-9700d5f4-273e-4517-9cb4-27c95fc747f1'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.068059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] The token cache is being invalidate because project fae6e48112664411928c757360038939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:28.068412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.069004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9700d5f4-273e-4517-9cb4-27c95fc747f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.071157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1178/2360] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:27 2022] DELETE /identity/v3/projects/fae6e48112664411928c757360038939 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:28.078121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.078412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.078693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.099902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.101106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.140033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.166242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1183/2361] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:28.176017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.176406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.176716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.196146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.197346 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.205240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1179/2362] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:28.209949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.219726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf491473-facd-4e3b-94f9-6eff9c3521e5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.224926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.225563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.225843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.226145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.226980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:28.227296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.229207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.241554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1184/2363] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:28.245826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.255144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00067518-1fdf-49df-8a19-73db6bc75c18 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.259939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.260571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.260857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.261134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.261815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.263731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.293414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1180/2364] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:28.297766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.307780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2233f5c-ffce-4d43-b629-0951508c08ae admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.367164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.367861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.368141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.368413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.369076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.371050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.392187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1185/2365] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:28.397155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.407767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40128-310e-41b2-869b-76dd4f842ca3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.412352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.412955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.413234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.413505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.414210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.415840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.425635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1181/2366] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:28.429541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.439251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70c93b-d0c1-4c21-bd8c-e77717708202 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.444295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.444886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.445162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.445433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.446117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.447700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29990f1-f9d2-4ec0-9e82-cd50cf8217c6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.459417 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1186/2367] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:28.463706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.473866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433688-57cb-4d16-8f54-e22af2df4c42 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.478482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.479136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.479421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.479701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] PATH_INFO: `/v3/projects/613b0bd8d81a443eb1db89d854f2b93c/users/95fe16e6bfbf4f5ba343aadf6dd54c89/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.494037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613b0bd8d81a443eb1db89d854f2b93c, user_id=95fe16e6bfbf4f5ba343aadf6dd54c89, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.496658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.510155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1182/2368] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:28 2022] PUT /identity/v3/projects/613b0bd8d81a443eb1db89d854f2b93c/users/95fe16e6bfbf4f5ba343aadf6dd54c89/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:28.521987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.522461 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.522556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.549757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] MFA Rules not processed for user `95fe16e6bfbf4f5ba343aadf6dd54c89`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.551001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.614676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1187/2369] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:28.626030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.628248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.684049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa016372-4ae4-4938-a35d-ee6b6c26ad13 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.687626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.688267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.688544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.688815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.697431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.698863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf34487-07fc-4829-b387-686ec11d611a service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.708213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1183/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:28.729432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.771617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.793428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c73cb-22a2-49cc-be6c-1dd9352d8a1d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:28.798260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:28.798910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.799687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.799992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] PATH_INFO: `/v3/users/95fe16e6bfbf4f5ba343aadf6dd54c89` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.801249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fe16e6bfbf4f5ba343aadf6dd54c89)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:28.803310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:28.857825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fe16e6bfbf4f5ba343aadf6dd54c89'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.858611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fe16e6bfbf4f5ba343aadf6dd54c89'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.866935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fe16e6bfbf4f5ba343aadf6dd54c89'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.875053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fe16e6bfbf4f5ba343aadf6dd54c89'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.888003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fe16e6bfbf4f5ba343aadf6dd54c89'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:28.894210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1188/2371] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:28 2022] DELETE /identity/v3/users/95fe16e6bfbf4f5ba343aadf6dd54c89 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:28.898517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:28.898811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:28.899119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:28.918597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:28.919760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:28.946846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:28.983360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1184/2372] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:28.993516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:28.994912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:29.051466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fe00-508a-4b8f-8875-3782d728be91 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.054971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.055576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.055883 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.056159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.065751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.067153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293970a-0342-4090-9dc2-60f4fa4e3e5f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.076734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1189/2373] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:29.362982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.364375 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:29.380673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf70f7-1a18-481c-b9de-24ad738b3a71 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.387454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.388474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.388474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.388749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] PATH_INFO: `/v3/projects/613b0bd8d81a443eb1db89d854f2b93c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.390186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613b0bd8d81a443eb1db89d854f2b93c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.392177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.455072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613b0bd8d81a443eb1db89d854f2b93c', 'request_id': 'req-eb07f071-63ff-4939-bf4a-5e03c375f6c3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:29.463975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613b0bd8d81a443eb1db89d854f2b93c', 'request_id': 'req-eb07f071-63ff-4939-bf4a-5e03c375f6c3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:29.470051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613b0bd8d81a443eb1db89d854f2b93c', 'request_id': 'req-eb07f071-63ff-4939-bf4a-5e03c375f6c3'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:29.481590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] The token cache is being invalidate because project 613b0bd8d81a443eb1db89d854f2b93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:29.481881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:29.482517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-eb07f071-63ff-4939-bf4a-5e03c375f6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:29.484063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1185/2374] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:29 2022] DELETE /identity/v3/projects/613b0bd8d81a443eb1db89d854f2b93c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:29.489601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.489885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.490163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.508957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:29.510149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:29.560951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:29.574745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1190/2375] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:29.578059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.578349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.578629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.599148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:29.600376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:29.608270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1186/2376] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:29.612420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.622059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc5eed-724f-418a-8d6d-462c82f79b4b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.626673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.627351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.627638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.627954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.628655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:29.628964 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.630563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.642066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1191/2377] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:29.646639 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.656113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ff286-7db4-45da-9624-dd51431ed1cb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.662251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.662865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.663150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.663424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.664142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.666055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.695494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1187/2378] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:29 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:29.699654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.710262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d8bf-742b-457b-91a3-c30e943294b4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.766048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.766669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.766977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.767260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.768471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.770431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.791364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1192/2379] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:29 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:29.795658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.806431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af6ad-f025-4559-a218-819f7955a994 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.811126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.811670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.811978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.812250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.812937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.814530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.825126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1188/2380] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:29.829075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.838857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522b34-40c4-47b6-bb5a-c04648e71f29 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.843398 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.844022 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.844304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.844578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.845273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.847358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50d65b-95fb-410d-a0fd-6fe4c3dcda1c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.857857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1193/2381] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:29.862461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:29.872373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fa05c-d2c9-49bd-aa8f-8463244609ca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:29.876892 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:29.877533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.877816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.878091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] PATH_INFO: `/v3/projects/8aa143d11f5140e987ddd7a662282361/users/043539d5616446cd9f008bf5222f24d7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:29.892373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa143d11f5140e987ddd7a662282361, user_id=043539d5616446cd9f008bf5222f24d7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:29.894994 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:29.907740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1189/2382] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:29 2022] PUT /identity/v3/projects/8aa143d11f5140e987ddd7a662282361/users/043539d5616446cd9f008bf5222f24d7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:29.972943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:29.973238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:29.973521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.005188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] MFA Rules not processed for user `043539d5616446cd9f008bf5222f24d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:30.006439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:30.071504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1194/2383] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:30.075951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.129735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.142870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337b7bc-98b7-418c-89ae-4b44775a565b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.148763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.149398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.149681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.149963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.150758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.152953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.184227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1190/2384] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:30.188303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.199767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54aed-d1c8-45f3-9fd4-241e89ba4c59 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.251024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:30.259158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.259816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.260104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.260382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.261047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.262999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.284981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1195/2385] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:30.289132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.299598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee8021-6e37-4216-973d-a21afe6ff82b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.304325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.304935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.305218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.305493 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.306196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.307819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.318590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1191/2386] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:30.322639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.333090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0d76a-6024-4aee-a436-e77433557710 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.337692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.338289 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.338567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.338837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.339619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.341820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae096bc-4878-4f29-b754-a90194215254 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.352361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1196/2387] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:30.356629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.366561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f741d-e51c-4d06-b6ae-0217e1688006 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.371170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.371865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.372144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.372416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] PATH_INFO: `/v3/projects/42fe731914cb411dad07d0e2d8aaea6e/users/ab745626e8404d25984a8b66b22bee0d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.387226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fe731914cb411dad07d0e2d8aaea6e, user_id=ab745626e8404d25984a8b66b22bee0d, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.389934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.405686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1192/2388] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:30 2022] PUT /identity/v3/projects/42fe731914cb411dad07d0e2d8aaea6e/users/ab745626e8404d25984a8b66b22bee0d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:30.416351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.416648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.416930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.446657 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] MFA Rules not processed for user `ab745626e8404d25984a8b66b22bee0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:30.448299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:30.519391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1197/2389] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:30.523969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.589119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65d9d6-d487-4c93-be5d-c2c04800764e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.593966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.594583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.594868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.595172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.596450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.598372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.625306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1193/2390] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:30.629266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.640029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5d35-8054-47c6-be95-33821c5dfe2b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.700696 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.701329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.701650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.701888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.702560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.704537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.730136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1198/2391] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:30 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:30.733120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.744321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9101-e2e9-4cd0-970a-761aa83e229e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.749459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.750066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.750343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.750617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.751435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.753097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.764818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1194/2392] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:30.769140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.780283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e176b-66ec-4013-bd8a-61a2a248532a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:30.785861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:30.786531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:30.786812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:30.787091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] PATH_INFO: `/v3/projects/5f59ff459a324889951345c772a2be35/users/c9be1e030d7c4d7db1594e17631f0a90/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:30.927885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f59ff459a324889951345c772a2be35, user_id=c9be1e030d7c4d7db1594e17631f0a90, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:30.930547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:30.943601 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1199/2393] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:30 2022] PUT /identity/v3/projects/5f59ff459a324889951345c772a2be35/users/c9be1e030d7c4d7db1594e17631f0a90/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:30.947704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:30.957888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5228da-ca7e-49b2-9689-2f9945451609 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.014633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.015255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.015537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.015843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.016544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.018658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a613-a3b0-4107-962a-43ff8884a717 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.028753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1195/2394] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:31.033282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.043956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f844ea-e3b4-47ce-bad1-5e448c950978 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.048521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.049170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.049446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.049718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] PATH_INFO: `/v3/projects/5f59ff459a324889951345c772a2be35/users/c9be1e030d7c4d7db1594e17631f0a90/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.051641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f59ff459a324889951345c772a2be35, user_id=c9be1e030d7c4d7db1594e17631f0a90, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.054272 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.064610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1200/2395] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:31 2022] PUT /identity/v3/projects/5f59ff459a324889951345c772a2be35/users/c9be1e030d7c4d7db1594e17631f0a90/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:31.075190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.075507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.075815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.097281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.107086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] MFA Rules not processed for user `c9be1e030d7c4d7db1594e17631f0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:31.108379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:31.180249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1196/2396] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:31.191878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:31.193692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:31.213641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:31.258739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ce6fc-7600-41b2-a532-22db67ca7b01 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:31.262467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:31.263089 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:31.263371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:31.263645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:31.318497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:31.319949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:31.328621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1201/2397] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:32.820257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:32.829826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868800d-04a7-44a8-9286-ae9a09a3aeef None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:32.833909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:32.834513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:32.834802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:32.835080 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:32.890398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:32.891807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:32.901195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1197/2398] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:33.407298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:33.415086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c9a4b-4306-4855-b5f9-54f690bd79ae service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:33.418949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:33.419561 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:33.419861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:33.420132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:33.429890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:33.431303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:33.441566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1202/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:35.172339 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:35.174172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:35.278112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06962-1187-4c9d-8584-645324327003 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:35.284470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:35.285305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:35.285663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:35.286007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:35.288112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:35.303095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:35.304922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66966539-84d2-4341-84af-a8a15df55313 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:35.317772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1198/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:37.410549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.471895 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cbec-02af-4e84-90e7-164cb9943a9d service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.476280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.476907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.477182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.477478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] PATH_INFO: `/v3/users/043539d5616446cd9f008bf5222f24d7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.478626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043539d5616446cd9f008bf5222f24d7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.480550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.524515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043539d5616446cd9f008bf5222f24d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:37.525157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043539d5616446cd9f008bf5222f24d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:37.532397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043539d5616446cd9f008bf5222f24d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:37.537438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.541674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043539d5616446cd9f008bf5222f24d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:37.554994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043539d5616446cd9f008bf5222f24d7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:37.561164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1203/2401] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:37 2022] DELETE /identity/v3/users/043539d5616446cd9f008bf5222f24d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:37.565652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.566212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.566312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.584852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:37.586049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:37.599186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:37.646910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1199/2402] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:37.657070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:37.659162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:37.717564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e41a-480a-4f54-ab7f-1f1af7bcf512 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:37.726261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:37.726886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:37.727166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:37.727438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:37.737406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:37.738821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:37.748479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1204/2403] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:38.020467 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.021880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:38.035715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465ce34-7fbb-414e-a25f-ef2331b9a93e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.040481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.041133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.041468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.041744 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] PATH_INFO: `/v3/projects/8aa143d11f5140e987ddd7a662282361` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.043063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa143d11f5140e987ddd7a662282361)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.045051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.093678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa143d11f5140e987ddd7a662282361', 'request_id': 'req-3492e2c2-0729-4964-a5ca-cdd6d38b065f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.101220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa143d11f5140e987ddd7a662282361', 'request_id': 'req-3492e2c2-0729-4964-a5ca-cdd6d38b065f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.106783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa143d11f5140e987ddd7a662282361', 'request_id': 'req-3492e2c2-0729-4964-a5ca-cdd6d38b065f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.117736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] The token cache is being invalidate because project 8aa143d11f5140e987ddd7a662282361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:38.118027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.118663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.120235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1200/2404] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:38 2022] DELETE /identity/v3/projects/8aa143d11f5140e987ddd7a662282361 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:38.124201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.134051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93eb1b-071b-45ae-a369-95f6573ac289 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.193333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.193980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.194263 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.194540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] PATH_INFO: `/v3/users/ab745626e8404d25984a8b66b22bee0d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.195733 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab745626e8404d25984a8b66b22bee0d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.197675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.247334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab745626e8404d25984a8b66b22bee0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.247934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab745626e8404d25984a8b66b22bee0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.255628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab745626e8404d25984a8b66b22bee0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.262535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab745626e8404d25984a8b66b22bee0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.274991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab745626e8404d25984a8b66b22bee0d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.276424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.282708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1205/2405] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:38 2022] DELETE /identity/v3/users/ab745626e8404d25984a8b66b22bee0d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:38.552507 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.554015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:38.568219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492e2c2-0729-4964-a5ca-cdd6d38b065f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.625147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.625796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.626078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.626356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] PATH_INFO: `/v3/projects/42fe731914cb411dad07d0e2d8aaea6e` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.628153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fe731914cb411dad07d0e2d8aaea6e)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.630152 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.672259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:38.676174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fe731914cb411dad07d0e2d8aaea6e', 'request_id': 'req-013a3ecd-8266-45f9-b2a8-66f070c59c98'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.684278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fe731914cb411dad07d0e2d8aaea6e', 'request_id': 'req-013a3ecd-8266-45f9-b2a8-66f070c59c98'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.690495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fe731914cb411dad07d0e2d8aaea6e', 'request_id': 'req-013a3ecd-8266-45f9-b2a8-66f070c59c98'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.701398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] The token cache is being invalidate because project 42fe731914cb411dad07d0e2d8aaea6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:38.701689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.702323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.703864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1201/2406] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:38 2022] DELETE /identity/v3/projects/42fe731914cb411dad07d0e2d8aaea6e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:38.707989 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:38.709439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:38.722245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b759-1019-45e0-b578-ec7831873835 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:38.780028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:38.780660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:38.780938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:38.781212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] PATH_INFO: `/v3/users/c9be1e030d7c4d7db1594e17631f0a90` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:38.782361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9be1e030d7c4d7db1594e17631f0a90)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:38.785798 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:38.840070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9be1e030d7c4d7db1594e17631f0a90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.840873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9be1e030d7c4d7db1594e17631f0a90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.848650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9be1e030d7c4d7db1594e17631f0a90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.856451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9be1e030d7c4d7db1594e17631f0a90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.869476 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-278f0521-7d38-420d-abc3-26a063556d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9be1e030d7c4d7db1594e17631f0a90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:38.875457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1206/2407] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:38 2022] DELETE /identity/v3/users/c9be1e030d7c4d7db1594e17631f0a90 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:39.151056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.152739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.170805 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3ecd-8266-45f9-b2a8-66f070c59c98 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.238506 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.239154 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.239433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.239707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] PATH_INFO: `/v3/projects/5f59ff459a324889951345c772a2be35` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.240893 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f59ff459a324889951345c772a2be35)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.242975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.290118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f59ff459a324889951345c772a2be35', 'request_id': 'req-3a4029b7-e47d-42f2-938c-8914ebfcc07e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:39.299460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f59ff459a324889951345c772a2be35', 'request_id': 'req-3a4029b7-e47d-42f2-938c-8914ebfcc07e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:39.307796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f59ff459a324889951345c772a2be35', 'request_id': 'req-3a4029b7-e47d-42f2-938c-8914ebfcc07e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:39.323852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] The token cache is being invalidate because project 5f59ff459a324889951345c772a2be35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:39.324161 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:39.324815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3a4029b7-e47d-42f2-938c-8914ebfcc07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:39.329606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1202/2408] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:39 2022] DELETE /identity/v3/projects/5f59ff459a324889951345c772a2be35 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:39.331827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.332117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.332394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.354090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:39.355357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.415409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1207/2409] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:39.423210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.423502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.423815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.443479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:39.444733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.453356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1203/2410] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:39.458342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.468779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decddb0-8ac8-4ec3-bb86-8375252844a2 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.474569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.475358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.475632 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.475936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.476626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:39.477047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.478623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.491582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1208/2411] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:39.496334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.506053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89393b2d-4840-44ae-b800-a08e98745e8d None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.512914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.513535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.513826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.514103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.514775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.516979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.552385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1204/2412] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:39.553198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.560550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:39.564961 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50337-6392-4e3a-a6d9-b302c59efce4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.631729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.632402 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.632686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.632962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.633680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.635763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.658995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1209/2413] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:39.663205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.673622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b88604-dddf-45b7-8319-d8aed1dfb842 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.678701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.679377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.679796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.680059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.680794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.682408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.693108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1205/2414] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:39.697070 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.707654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e409e5-f0f4-4fc6-96f2-0dfd94655543 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.712237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.712866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.713141 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.713411 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.714094 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.715689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03dde6-315f-4e95-a93f-443dc050e6ef admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.726161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1210/2415] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:39.730209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.740287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266806e-d527-4d79-8b4c-f12835c7b692 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.745014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.745667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.745952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.746232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] PATH_INFO: `/v3/projects/1139f2b053a743ada79cf22446a95e6f/users/0c2d8f9464e042729270126f3ca04626/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.761411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1139f2b053a743ada79cf22446a95e6f, user_id=0c2d8f9464e042729270126f3ca04626, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.764116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.773354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:39.778767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1206/2416] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:39 2022] PUT /identity/v3/projects/1139f2b053a743ada79cf22446a95e6f/users/0c2d8f9464e042729270126f3ca04626/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:39.789662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.789888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.790167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.817820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] MFA Rules not processed for user `0c2d8f9464e042729270126f3ca04626`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:39.819028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.881353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1211/2417] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:39.893487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:39.895180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:39.951185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27f3d9-805e-4f3e-91af-077f51718ee3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:39.955471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:39.956567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:39.956850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:39.957125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:39.967712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:39.969231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:39.978603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1207/2418] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:40.047250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:40.049285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:40.107940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4c10-c495-43a4-8ba4-0e3fa3de79be None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:40.112926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:40.113930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:40.114346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:40.114839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:40.117219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:40.148900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:40.192146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:40.193643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:40.204378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1212/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:43.482727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.484614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:43.568331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.570626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:43.590485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb6dae-0a63-43e2-b900-ff267b2daddc service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.594461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e794330-8a5c-434d-8ca8-7542d8c913e1 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:43.599633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.600315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.600600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.600906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.602696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:43.606479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:43.607140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:43.607419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:43.607694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] PATH_INFO: `/v3/users/eb570550f73e4d6a8c87d2bc0c12b4b7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:43.608907 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb570550f73e4d6a8c87d2bc0c12b4b7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.610850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.615316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:43.617074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:43.629070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1208/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:43.673096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb570550f73e4d6a8c87d2bc0c12b4b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:43.673902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb570550f73e4d6a8c87d2bc0c12b4b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:43.681143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb570550f73e4d6a8c87d2bc0c12b4b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:43.688671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb570550f73e4d6a8c87d2bc0c12b4b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:43.702507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d70aa86c-b8b8-4203-b542-2ee03f1faf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb570550f73e4d6a8c87d2bc0c12b4b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:43.712060 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1213/2421] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:43 2022] DELETE /identity/v3/users/eb570550f73e4d6a8c87d2bc0c12b4b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:43.955511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:43.966463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2408fc-7881-4415-98bf-eb7e93074e97 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.036409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.036979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.037266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.037549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] PATH_INFO: `/v3/projects/0085179de0474e629a22a84d07968174` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.038704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0085179de0474e629a22a84d07968174)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.040662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.078975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.089016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0085179de0474e629a22a84d07968174', 'request_id': 'req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:44.097187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0085179de0474e629a22a84d07968174', 'request_id': 'req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:44.103808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0085179de0474e629a22a84d07968174', 'request_id': 'req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:44.116517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] The token cache is being invalidate because project 0085179de0474e629a22a84d07968174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:44.116807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:44.117482 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3e83bedb-ddf6-4862-8bd1-15e7f527f7db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:44.118995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1209/2422] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:43 2022] DELETE /identity/v3/projects/0085179de0474e629a22a84d07968174 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:44.124091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.124378 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.124655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.143538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:44.144753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:44.213332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1214/2423] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:44.216136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.216432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.216710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.239011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:44.240290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:44.251887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1210/2424] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:44.253239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.263064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2840f0-0a2d-4436-a56a-1c9377470c62 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.268128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.268749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.269033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.269305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.270014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:44.270303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.272301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.285879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1215/2425] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:44.290374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.300349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1935-a7ab-4565-8bde-c23e4962f16b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.305267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.305894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.306180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.306459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.307179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.309397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.337058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1211/2426] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:44 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:44.341233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.351852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174a118-2771-4fe3-9315-5726d659667e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.371588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:44.413903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.414566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.414882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.415182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.415899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.417871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.440267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1216/2427] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:44 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:44.444325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.454756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6f002-a42c-42d4-9688-456288901d63 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.460266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.460992 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.461386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.461729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.462502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.464234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.475522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1212/2428] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:44.479531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.490134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1686e40-c572-43b4-9ec4-c6d2f6f044fc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.494698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.495300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.495584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.495922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.496621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.498248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ea955-9bb6-4cf9-980c-53c2f107fac8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.508669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1217/2429] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:44.512601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.523020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c6ea-abfa-4456-a623-dee2034c7f77 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.528597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.529248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.529786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.530066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] PATH_INFO: `/v3/projects/c5f52ea8412d4af5bc98da9028fa7635/users/c1fb265a1f974a5c834cfa3e39c3108d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.545299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f52ea8412d4af5bc98da9028fa7635, user_id=c1fb265a1f974a5c834cfa3e39c3108d, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.548007 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.560533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1213/2430] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:44 2022] PUT /identity/v3/projects/c5f52ea8412d4af5bc98da9028fa7635/users/c1fb265a1f974a5c834cfa3e39c3108d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:44.570572 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.571095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.571095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.598969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] MFA Rules not processed for user `c1fb265a1f974a5c834cfa3e39c3108d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:44.600204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:44.663211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1218/2431] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:44.674478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:44.676267 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:44.749629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe27258-bbb1-488b-a006-82f23cb6200d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:44.755184 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:44.755826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:44.756112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:44.756391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:44.764074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:44.765697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc424c5-a303-47e9-91aa-ef8ac806ed3c service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:44.774778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1214/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:50.038202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.102450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54eee7-dfad-4fdb-bf15-45dddbf319aa None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.107466 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.108150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.108440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.108700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] PATH_INFO: `/v3/users/c1fb265a1f974a5c834cfa3e39c3108d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.109917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fb265a1f974a5c834cfa3e39c3108d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.112347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.150794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.165616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fb265a1f974a5c834cfa3e39c3108d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.166322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fb265a1f974a5c834cfa3e39c3108d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.173845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fb265a1f974a5c834cfa3e39c3108d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.180840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fb265a1f974a5c834cfa3e39c3108d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.193096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fb265a1f974a5c834cfa3e39c3108d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.199116 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1219/2433] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:50 2022] DELETE /identity/v3/users/c1fb265a1f974a5c834cfa3e39c3108d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:50.203613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.204169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.204352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.223647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:50.224885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:50.266284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:50.289398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1215/2434] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:50.299397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.300938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:50.363205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85efc4-adcf-49c1-be61-f4d7458f2655 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.369832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.369832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.369832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.369832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.378967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.380489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47976a7-0810-4f44-ba1b-f9379ef92e71 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.401146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1220/2435] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:50.716912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.718552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:50.731757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0b526-b0c1-4bda-8f12-cfa694466f39 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.736559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.737160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.737443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.737782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] PATH_INFO: `/v3/projects/c5f52ea8412d4af5bc98da9028fa7635` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.739016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f52ea8412d4af5bc98da9028fa7635)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.740985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:50.795293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f52ea8412d4af5bc98da9028fa7635', 'request_id': 'req-61639cc8-4613-4b1f-978a-46e1d0f5518c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.804565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f52ea8412d4af5bc98da9028fa7635', 'request_id': 'req-61639cc8-4613-4b1f-978a-46e1d0f5518c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.811205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f52ea8412d4af5bc98da9028fa7635', 'request_id': 'req-61639cc8-4613-4b1f-978a-46e1d0f5518c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.824964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] The token cache is being invalidate because project c5f52ea8412d4af5bc98da9028fa7635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:50.825205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.825869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-61639cc8-4613-4b1f-978a-46e1d0f5518c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:50.832119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1216/2436] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:50 2022] DELETE /identity/v3/projects/c5f52ea8412d4af5bc98da9028fa7635 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:50.833629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.833974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.834596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.861280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:50.863249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:50.930788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1221/2437] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:50.940109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.940402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.940683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.960898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:50.962106 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:50.969999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1217/2438] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:50.974188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:50.983996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414fabb-8b25-4e2f-97c4-2b047213b340 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:50.988704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:50.989258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:50.989513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:50.989836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:50.990522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:50.990824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:50.992913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.005114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1222/2439] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:51.009480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.020331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f3119-b71c-489e-bcfb-ff2cd65c8327 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.025003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.025822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.026138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.026468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.027313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.029633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.057670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1218/2440] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:51.062011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.072803 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c344-6c44-4ef4-9c1c-ba46d8cacdeb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.112188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.132617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.133282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.133566 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.133842 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.134504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.136472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.157810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1223/2441] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:51.161968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.172234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093608-df6b-4ba1-bf08-4e741edd94f5 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.176869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.177492 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.177763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.178039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.178733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.180399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.190836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1219/2442] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:51.194722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.205232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69356-6a1f-48f9-b23c-47df7d71acfd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.209853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.210451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.210730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.211004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.211693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.213302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014327b-0197-418a-bf72-21f8a0e400c5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.223138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1224/2443] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:51.227094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.237757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef74442-bc9c-4b5e-aba6-855293322cca admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.242594 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.243259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.243545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.243884 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] PATH_INFO: `/v3/projects/d50c0b057a3948839f767cf06fcc61f0/users/ff90f4e171af4c2fadddc899a707acd4/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.259212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50c0b057a3948839f767cf06fcc61f0, user_id=ff90f4e171af4c2fadddc899a707acd4, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.261910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.274640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1220/2444] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:51 2022] PUT /identity/v3/projects/d50c0b057a3948839f767cf06fcc61f0/users/ff90f4e171af4c2fadddc899a707acd4/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:51.285310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.285625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.285919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.315177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] MFA Rules not processed for user `ff90f4e171af4c2fadddc899a707acd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:51.316408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:51.378531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1225/2445] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:51.383139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.451548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af3bce-f7f7-4c1b-af63-19caeaddccd2 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.456338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.456964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.457252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.457533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.458226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.460193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.470240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.488659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1221/2446] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:51.493328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.504773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2100b2-f101-4e5a-83b3-c512d7bd9732 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.559329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.559974 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.560253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.560522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.561189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.563114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.584793 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1226/2447] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:51.588865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.599561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e12f-f33d-498e-99af-7133d6381acc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.604179 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.605515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.606433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.606711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.607407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.609069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.619511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1222/2448] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:51.623548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.633682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f749d-eead-4815-b7e5-59ec1331b044 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.638322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.638972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.639253 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.639527 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] PATH_INFO: `/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45/users/b65e79075eb34d34a89752782879f4a6/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.653863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=784e1ef2aba540bdb1521c3fa15b4f45, user_id=b65e79075eb34d34a89752782879f4a6, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.656785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.671441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1227/2449] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:51 2022] PUT /identity/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45/users/b65e79075eb34d34a89752782879f4a6/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:51.676207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.686266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdd8-bbd7-4b00-b551-eac9f62c4ab6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.749231 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.749862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.750147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.750425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.751265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.752889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.763434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1223/2450] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:51.767656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.784145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2103a-ab64-41f7-9b7a-bb6d5e8cc68f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.787216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.787917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.788056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.788497 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.788872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] PATH_INFO: `/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45/users/b65e79075eb34d34a89752782879f4a6/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.790045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:51.790848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] RBAC: Authorizing `identity:create_grant(project_id=784e1ef2aba540bdb1521c3fa15b4f45, user_id=b65e79075eb34d34a89752782879f4a6, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.793522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2be5f2-fca3-4f17-8a2b-8f347808202b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.801035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.806266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1228/2451] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:51 2022] PUT /identity/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45/users/b65e79075eb34d34a89752782879f4a6/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:51.816464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.816749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.817027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.846427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] MFA Rules not processed for user `b65e79075eb34d34a89752782879f4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:51.847640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:51.849691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0a0ff-5862-40d6-94eb-dccd8e476455 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:51.899110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:51.900220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:51.900509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:51.900836 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:51.902764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:51.919718 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1229/2452] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:51.933228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:51.934613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:51.950175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:51.976153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:51.977664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:51.989807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1224/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:52.000066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870eeb7-fbd2-444d-a5cf-be0f0754c1ea None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.003888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.004510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.004799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.005072 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.014630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.016214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.027406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1230/2454] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:52.113879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:52.124431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267295-31a5-422b-9458-1718f415723e service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:52.128760 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:52.129316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:52.129600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:52.129877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:52.201415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:52.203091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:52.213386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1225/2455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:55.145672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.147507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.166416 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abde2b6-7555-4838-9b96-ad9af8638dc8 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.169184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.169945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.170298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.170647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] PATH_INFO: `/v3/users/b23a317904864972b875257cfcd90277` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.172048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23a317904864972b875257cfcd90277)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.174100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.228570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23a317904864972b875257cfcd90277'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.229550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23a317904864972b875257cfcd90277'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.237826 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.246951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23a317904864972b875257cfcd90277'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.255070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053810-17b9-40d2-b4be-bc748dfe2c27 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.257458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23a317904864972b875257cfcd90277'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.260730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.261494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.261876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.262257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] PATH_INFO: `/v3/users/ff90f4e171af4c2fadddc899a707acd4` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.263569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff90f4e171af4c2fadddc899a707acd4)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.265706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.272545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-adc8601c-9051-4ea4-9600-bc64c9365f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23a317904864972b875257cfcd90277'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.276670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.283794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1231/2456] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:55 2022] DELETE /identity/v3/users/b23a317904864972b875257cfcd90277 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:55.327520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff90f4e171af4c2fadddc899a707acd4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.330827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff90f4e171af4c2fadddc899a707acd4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.338552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff90f4e171af4c2fadddc899a707acd4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.350248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff90f4e171af4c2fadddc899a707acd4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.351226 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff90f4e171af4c2fadddc899a707acd4'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.379788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1226/2457] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:55 2022] DELETE /identity/v3/users/ff90f4e171af4c2fadddc899a707acd4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:55.384261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.384261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.384261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.410796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:55.412065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.478106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1232/2458] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:55.488791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.490246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.495788 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.497058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.515932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9720c96-94fe-4e2c-b38f-a57463bdc155 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.521948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.522713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.522995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.523309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] PATH_INFO: `/v3/projects/07a612a0930b43c396ee35b7acafa61c` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.524613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a612a0930b43c396ee35b7acafa61c)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.528031 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.559292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a4741-9393-4729-ae23-e78d39b3cf0e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.563060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.563736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.564047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.564324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.570378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.575678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.577319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a612a0930b43c396ee35b7acafa61c', 'request_id': 'req-1cabe6aa-f62c-456d-8ecd-0a480d10e188'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.577629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a61ba0-73ad-4501-87c6-6c3e3514d922 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.590475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a612a0930b43c396ee35b7acafa61c', 'request_id': 'req-1cabe6aa-f62c-456d-8ecd-0a480d10e188'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.592999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1227/2459] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:55.597593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a612a0930b43c396ee35b7acafa61c', 'request_id': 'req-1cabe6aa-f62c-456d-8ecd-0a480d10e188'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.608822 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] The token cache is being invalidate because project 07a612a0930b43c396ee35b7acafa61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:55.609111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.609855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1cabe6aa-f62c-456d-8ecd-0a480d10e188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:55.612892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1233/2460] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:55 2022] DELETE /identity/v3/projects/07a612a0930b43c396ee35b7acafa61c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:55.619667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.620001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.620290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.640584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:55.641842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.720669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1228/2461] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:55.729773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.730062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.730389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.753178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:55.757935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.769352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1234/2462] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:55.773655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.784537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8d3ae-b4d2-4a4f-9bc0-fff7b652abbb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.789449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.790082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.790369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.790650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.791360 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:55.791690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.793929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.809371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1229/2463] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:04:55.813652 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.823160 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc67793-26a0-4b87-a1e4-7ffd860ce955 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.828073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.828721 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.829391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.829667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.830463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.832711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.877296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1235/2464] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:55.881742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.889865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:55.892090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:55.893562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c923-afad-46bf-bda9-3068e6751190 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.962212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:55.963808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.964558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.964862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.965166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.966087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.968295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.972218 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab9c4-7845-47db-aeb4-6a4051313209 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:55.979066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:55.979896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:55.980179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:55.980451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] PATH_INFO: `/v3/projects/d50c0b057a3948839f767cf06fcc61f0` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:55.981692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50c0b057a3948839f767cf06fcc61f0)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:55.983812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:55.992063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1230/2465] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:55 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:55.996160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.006330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e584a97-b566-4a13-b9a9-b983532b46ed admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.011188 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.011820 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.012108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.012382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.013076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.014728 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.027797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1231/2466] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:56.030491 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.038567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50c0b057a3948839f767cf06fcc61f0', 'request_id': 'req-19a0d792-cd89-427c-804c-e29089217671'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.040427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d48f4-0991-4d90-909c-8ca29abb005d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.046664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50c0b057a3948839f767cf06fcc61f0', 'request_id': 'req-19a0d792-cd89-427c-804c-e29089217671'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.053115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50c0b057a3948839f767cf06fcc61f0', 'request_id': 'req-19a0d792-cd89-427c-804c-e29089217671'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.064403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] The token cache is being invalidate because project d50c0b057a3948839f767cf06fcc61f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:56.064889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.065939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.067630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1236/2467] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:55 2022] DELETE /identity/v3/projects/d50c0b057a3948839f767cf06fcc61f0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:56.071929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.073787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.101199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.101747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.102036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.102316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.103014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.104658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.105975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.116338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1232/2468] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:56.120811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.124565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.138422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf8e8-0c17-4948-a89b-4c40fd637ec4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.143868 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.144574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.144864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.145146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] PATH_INFO: `/v3/projects/f283083e2af54af4a0c8db8a76025e6a/users/2237ab7e83e444f0bad469f8e149b50f/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.146424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0d792-cd89-427c-804c-e29089217671 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.151114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.151930 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.152233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.152508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] PATH_INFO: `/v3/users/b65e79075eb34d34a89752782879f4a6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.153971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65e79075eb34d34a89752782879f4a6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.156172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.160811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f283083e2af54af4a0c8db8a76025e6a, user_id=2237ab7e83e444f0bad469f8e149b50f, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.163471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6b780-6b46-4187-9749-f566d6c26b0f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.184566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1233/2469] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:56 2022] PUT /identity/v3/projects/f283083e2af54af4a0c8db8a76025e6a/users/2237ab7e83e444f0bad469f8e149b50f/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:56.200701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.200975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.201370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.217645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65e79075eb34d34a89752782879f4a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.218307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65e79075eb34d34a89752782879f4a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.226641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65e79075eb34d34a89752782879f4a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.236967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65e79075eb34d34a89752782879f4a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.238959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] MFA Rules not processed for user `2237ab7e83e444f0bad469f8e149b50f`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:56.240257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.253098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65e79075eb34d34a89752782879f4a6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.259422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1237/2470] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:56 2022] DELETE /identity/v3/users/b65e79075eb34d34a89752782879f4a6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:56.318457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1234/2471] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:56.319542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.321042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.329185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.394682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257d62d-2cf0-4aac-a0bd-98eb811038d6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.399424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.400092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.400403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.400659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.401346 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.403268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.442715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1238/2472] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:56.445029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.521370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8b65f-39ba-4e8a-8e6d-6bfcae15f9ce None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.583889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.583889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.583889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.583889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.584311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.585771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.586848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.587899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.606347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b3c9-3765-4d39-951b-30d35d9f74df admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.609755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.613869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.615004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.615343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.615844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] PATH_INFO: `/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.617469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784e1ef2aba540bdb1521c3fa15b4f45)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.619311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1235/2473] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:56.619722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.623097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.633108 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472845-50b4-45f1-adef-303e4fe7353d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.638241 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.638991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.639416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.640006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.640844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.643355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.654478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1236/2474] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:56.659987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.669840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d230461-fe93-4aa4-94b8-d77a992c7c1f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.676257 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784e1ef2aba540bdb1521c3fa15b4f45', 'request_id': 'req-f36886be-bfc4-4259-a352-c180e771c883'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.689972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784e1ef2aba540bdb1521c3fa15b4f45', 'request_id': 'req-f36886be-bfc4-4259-a352-c180e771c883'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.700308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784e1ef2aba540bdb1521c3fa15b4f45', 'request_id': 'req-f36886be-bfc4-4259-a352-c180e771c883'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.713362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] The token cache is being invalidate because project 784e1ef2aba540bdb1521c3fa15b4f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:04:56.713977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.722948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f36886be-bfc4-4259-a352-c180e771c883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:56.725328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1239/2475] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:04:56 2022] DELETE /identity/v3/projects/784e1ef2aba540bdb1521c3fa15b4f45 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:56.730848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563fc9-48bc-44da-bcce-eebe3f992609 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.731138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563fc9-48bc-44da-bcce-eebe3f992609 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.731445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38563fc9-48bc-44da-bcce-eebe3f992609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.749186 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.749862 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.750145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.750418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] PATH_INFO: `/v3/projects/2a48534e36984c3d987dc0ed91931f79/users/aa93a1910dd24656810870845583180d/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.751023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-38563fc9-48bc-44da-bcce-eebe3f992609 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:56.752325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-38563fc9-48bc-44da-bcce-eebe3f992609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.760669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1240/2476] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:56.765832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a48534e36984c3d987dc0ed91931f79, user_id=aa93a1910dd24656810870845583180d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.769003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.769323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.769610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.769749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.784999 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1237/2477] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:56 2022] PUT /identity/v3/projects/2a48534e36984c3d987dc0ed91931f79/users/aa93a1910dd24656810870845583180d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:56.789089 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.790894 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.791363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:56.792580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:56.853563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1241/2478] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:56.857990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.858469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f41936-13e1-478f-a0ab-bdbebc7fc532 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.864562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.865245 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.865532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.865809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.866519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.868032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b1dd1-7a78-4c91-a50c-f2272557b69a None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.868252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.872938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.873498 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.873781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.874068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.874909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:04:56.875225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.877449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.879135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:56.880364 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1238/2479] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:56.885010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.893056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1242/2480] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:04:56.895668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e9f6c-4507-4b19-a969-84ae78fd8655 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.897134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.900637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.901298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.901578 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.901853 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] PATH_INFO: `/v3/projects/2a48534e36984c3d987dc0ed91931f79/users/aa93a1910dd24656810870845583180d/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.903833 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a48534e36984c3d987dc0ed91931f79, user_id=aa93a1910dd24656810870845583180d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.906854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c1425-70d2-4efa-a5ea-bb42a6e4eccd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.907431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d330c-7e08-431c-ab81-cde8e7af9ddd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:56.912146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:56.912753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.913052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.913345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.914026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:56.916073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:56.918626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1239/2481] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:56 2022] PUT /identity/v3/projects/2a48534e36984c3d987dc0ed91931f79/users/aa93a1910dd24656810870845583180d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:56.929995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:56.930389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:56.930674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:56.947613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1243/2482] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:56.948892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:56.960615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] MFA Rules not processed for user `aa93a1910dd24656810870845583180d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:56.961857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.008530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.025534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57e49-c542-4592-a03c-fd3e104b2dd4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.031166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.031814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.032178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.032750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.033505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.035467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.037359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1240/2483] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:57.049779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.051466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.061440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1244/2484] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:56 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:57.066150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.076380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05812ce9-3a18-41ca-8479-5fa4269816db admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.081975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.082582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.082864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.083139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.083860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.085447 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.096728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1245/2485] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:04:57.101168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.111429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a30ad6-13fc-4827-9e8c-df3a9df76c78 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.113142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcad8a-b5ab-4658-9f0d-0ae4a692272a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.116364 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.116787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.117007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.117292 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.117393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.117672 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.117774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.117945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.118542 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.119789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.120173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.132939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1246/2486] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:57.136876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.147587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001c07-926e-4782-8b70-432d5462b8bf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.155362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.155362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.155362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.155362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] PATH_INFO: `/v3/projects/56a05dad72174909b84091240bc5c990/users/c060c1e13cb949159b6272756db3d945/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.170299 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a05dad72174909b84091240bc5c990, user_id=c060c1e13cb949159b6272756db3d945, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.173020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4713e01-c484-4493-bf01-43caae234c63 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.184287 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.185747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.186742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1247/2487] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:57 2022] PUT /identity/v3/projects/56a05dad72174909b84091240bc5c990/users/c060c1e13cb949159b6272756db3d945/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:57.196731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1241/2488] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:04:57.198225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.198438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.198710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.226709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] MFA Rules not processed for user `c060c1e13cb949159b6272756db3d945`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:57.228111 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.295922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1248/2489] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:04:57.301063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.311902 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de81733-c304-4707-833d-e7d281c270c0 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.378673 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.379369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.379684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.380074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.380806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.382898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.412105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1242/2490] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:04:57 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:04:57.416393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.428810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.433796 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184876-c93e-4e88-be38-58a8fe3a74b8 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.505588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.506318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.506605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.506879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.507564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.509639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.537082 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1249/2491] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:04:57 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:04:57.541393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.553118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8460c3-284c-4257-97e0-faabd3119d17 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.558147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.558763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.559044 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.559318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.560056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.561765 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.574403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1243/2492] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:57.578593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.588611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a5365-2b4d-4902-a0be-6f3d31149404 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.593248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.593904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.594192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.595034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] PATH_INFO: `/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24/users/eeb4130362c541f683e97194eca9a17a/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.609932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05be8fba2e3d48ce8f1b1a3cab184e24, user_id=eeb4130362c541f683e97194eca9a17a, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.613446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.627878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1250/2493] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:57 2022] PUT /identity/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24/users/eeb4130362c541f683e97194eca9a17a/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:57.631896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.642126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d2ba-41ce-4892-89b4-fad1e38de1c6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.645797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:57.701939 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.702561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.702845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.703122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.703873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.705528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19c43d-0baf-4306-912b-c7be34e3abbb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.716035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1244/2494] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:04:57.720887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.731349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905c569-44f9-4d93-a179-17efaa499d33 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.736617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.737286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.737569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.737845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] PATH_INFO: `/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24/users/eeb4130362c541f683e97194eca9a17a/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.739944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05be8fba2e3d48ce8f1b1a3cab184e24, user_id=eeb4130362c541f683e97194eca9a17a, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.742701 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.755392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1251/2495] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:04:57 2022] PUT /identity/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24/users/eeb4130362c541f683e97194eca9a17a/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:04:57.767343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.767762 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.768049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.797165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] MFA Rules not processed for user `eeb4130362c541f683e97194eca9a17a`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:57.798985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.869033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1245/2496] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:57.879850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:57.881559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:57.940868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842b46-5e5b-4246-8fc4-2ff397a5a73f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:57.944492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:57.945110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:57.945394 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:57.945670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:57.966017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:57.967515 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:57.977565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1252/2497] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:58.585946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:58.596617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbaef9-c5e9-43d0-8448-8bbeb7f1e98a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:58.600130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:58.600726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:58.601011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:58.601284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:58.670651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:58.672353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808952d-fe89-4730-b168-005507f43c0a service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:58.684427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1246/2498] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:04:59.403195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.468666 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc8b9-4c37-4a06-af70-68e321b910db service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.473259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.473901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.474184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.474458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] PATH_INFO: `/v3/users/c060c1e13cb949159b6272756db3d945` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.475649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c060c1e13cb949159b6272756db3d945)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.477677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.479131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.526392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c060c1e13cb949159b6272756db3d945'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:59.527041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c060c1e13cb949159b6272756db3d945'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:59.534619 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c060c1e13cb949159b6272756db3d945'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:59.541649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c060c1e13cb949159b6272756db3d945'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:59.559357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c060c1e13cb949159b6272756db3d945'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:04:59.566224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1253/2499] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:04:59 2022] DELETE /identity/v3/users/c060c1e13cb949159b6272756db3d945 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:04:59.570723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.571017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.571295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.589929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:04:59.591163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:59.608072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:04:59.651928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1247/2500] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:04:59.662639 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:04:59.664115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:04:59.722495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f1c8-6897-4965-aa5d-e2857e5c46fc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:04:59.726085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:04:59.726700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:04:59.726975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:04:59.727245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:04:59.736621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:04:59.737978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:04:59.747259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1254/2501] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:00.041162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.042686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:00.060032 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782bb3a-47f8-4265-936c-1d7449414bc5 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.066369 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.066856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.067137 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.067413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] PATH_INFO: `/v3/projects/56a05dad72174909b84091240bc5c990` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.068638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a05dad72174909b84091240bc5c990)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.070570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.128666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a05dad72174909b84091240bc5c990', 'request_id': 'req-45f2e84e-4b98-4b92-825a-ea982ef83401'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.136420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a05dad72174909b84091240bc5c990', 'request_id': 'req-45f2e84e-4b98-4b92-825a-ea982ef83401'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.142883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a05dad72174909b84091240bc5c990', 'request_id': 'req-45f2e84e-4b98-4b92-825a-ea982ef83401'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.162256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] The token cache is being invalidate because project 56a05dad72174909b84091240bc5c990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:00.162559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.163228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.165057 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1248/2502] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:00 2022] DELETE /identity/v3/projects/56a05dad72174909b84091240bc5c990 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:00.168782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.179871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06992eee-2afe-439b-aff2-e119dcca9770 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.261214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.261862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.262145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.262424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] PATH_INFO: `/v3/users/eeb4130362c541f683e97194eca9a17a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.263611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb4130362c541f683e97194eca9a17a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.265621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.289794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.315105 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb4130362c541f683e97194eca9a17a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.315786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb4130362c541f683e97194eca9a17a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.322979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb4130362c541f683e97194eca9a17a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.330428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb4130362c541f683e97194eca9a17a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.342348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-186725fd-5cf0-4643-b0fb-cacaa51bf9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb4130362c541f683e97194eca9a17a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.348861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1255/2503] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:00 2022] DELETE /identity/v3/users/eeb4130362c541f683e97194eca9a17a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:00.632024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.633588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:00.648954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2e84e-4b98-4b92-825a-ea982ef83401 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.711767 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.712430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.712714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.712996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] PATH_INFO: `/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.714166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05be8fba2e3d48ce8f1b1a3cab184e24)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.716123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.763075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:00.764340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05be8fba2e3d48ce8f1b1a3cab184e24', 'request_id': 'req-862efcb5-e6f2-4cad-b4e1-2dd514c68133'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.774353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05be8fba2e3d48ce8f1b1a3cab184e24', 'request_id': 'req-862efcb5-e6f2-4cad-b4e1-2dd514c68133'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.780280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05be8fba2e3d48ce8f1b1a3cab184e24', 'request_id': 'req-862efcb5-e6f2-4cad-b4e1-2dd514c68133'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.793417 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] The token cache is being invalidate because project 05be8fba2e3d48ce8f1b1a3cab184e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:00.793692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.794356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-862efcb5-e6f2-4cad-b4e1-2dd514c68133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:00.795898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1249/2504] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:00 2022] DELETE /identity/v3/projects/05be8fba2e3d48ce8f1b1a3cab184e24 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:00.801006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.801500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.801598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.822564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:00.823779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:00.888811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1256/2505] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:00.897249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.897539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.897821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.921282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:00.921867 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:00.930197 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1250/2506] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:00.934491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.945059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f0cb7-b33f-4141-b30e-c9ef353f1671 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.950001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.950694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.951844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.956002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.956767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:00.957086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.958730 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:00.975781 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1257/2507] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:00.977461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:00.988095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64720b99-de73-45e0-8c63-8b74c199d327 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:00.992890 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:00.993534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:00.993821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:00.994099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:00.994779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:00.996784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.028835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1251/2508] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:00 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:01.031276 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.041428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddec0e-a0e0-452d-97e5-e92eb32b0527 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.105433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.106163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.106525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.106877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.107658 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.109800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.139682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1258/2509] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:01.141264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.152953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28c1c-6f38-454f-b02e-0c42c3849819 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.158279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.158974 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.159357 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.159643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.160526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.162165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.173372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1252/2510] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:01.178125 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.192232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d082d-8bba-4470-8e5d-0f0d1e4bd3f8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.196980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.197625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.197910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.198202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.198896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.201626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87024ca4-d3ab-47d1-bbff-779e06c98c03 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.211926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1259/2511] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:01.216162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.226248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bacb-041a-4d55-8790-8461fe847168 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.231575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.232342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.232667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.233018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] PATH_INFO: `/v3/projects/4c8e4313caaa4c5ebe641a73d1242524/users/490301173b0e406cb3dcac8c6dc08bdd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.252727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e4313caaa4c5ebe641a73d1242524, user_id=490301173b0e406cb3dcac8c6dc08bdd, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.255403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.269378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1253/2512] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:01 2022] PUT /identity/v3/projects/4c8e4313caaa4c5ebe641a73d1242524/users/490301173b0e406cb3dcac8c6dc08bdd/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:01.280178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.280390 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.280665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.294202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.321711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] MFA Rules not processed for user `490301173b0e406cb3dcac8c6dc08bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:01.323135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:01.397851 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1260/2513] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:01.399641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.475699 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8db8e-0a9e-4e1e-90c6-ba46becd5001 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.481334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.482159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.482552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.482938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.484016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.486731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.518690 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1254/2514] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:01.520301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.532667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7310a5-72a6-4445-acf0-1460826f26fe None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.595349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.596047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.596366 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.596642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.597347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.599330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.624773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1261/2515] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/users => generated 310 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:01.628904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.639233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801ea6-0ccb-4da7-974a-4379f12f92fb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.644855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.645637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.645953 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.646256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.647113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.648789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.665318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1255/2516] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:01.666768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.677412 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252c8dc-452c-477b-84b5-8b2a8a82f9e9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.682091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.682748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.683029 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.683306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] PATH_INFO: `/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba/users/fa9b6daf620b41508c2379fbefad9af6/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.698316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d1ccf7338e4225b8deee26b7ff65ba, user_id=fa9b6daf620b41508c2379fbefad9af6, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.701008 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.714075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1262/2517] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:01 2022] PUT /identity/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba/users/fa9b6daf620b41508c2379fbefad9af6/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:01.718793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.729998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805252c-b199-456e-8964-a86c1164559b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.776855 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:01.792389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.793001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.793352 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.793634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.794321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.796105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf3f30-1419-47e0-b47e-94e829564dc3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.806278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1256/2518] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:01.810529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.820877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54693f3-9797-43a3-be3c-05cc3f80630d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:01.825505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:01.826154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.826435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.826706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] PATH_INFO: `/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba/users/fa9b6daf620b41508c2379fbefad9af6/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.829203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d1ccf7338e4225b8deee26b7ff65ba, user_id=fa9b6daf620b41508c2379fbefad9af6, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:01.832154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:01.842560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1263/2519] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:01 2022] PUT /identity/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba/users/fa9b6daf620b41508c2379fbefad9af6/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:01.854173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767973-5905-4454-b417-7a0fed99e459 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:01.854489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767973-5905-4454-b417-7a0fed99e459 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:01.854771 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767973-5905-4454-b417-7a0fed99e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:01.882979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-62767973-5905-4454-b417-7a0fed99e459 None None] MFA Rules not processed for user `fa9b6daf620b41508c2379fbefad9af6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:01.884351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-62767973-5905-4454-b417-7a0fed99e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:01.954433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1257/2520] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:01.965100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:01.966753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:02.025880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:02.030242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af461b-97c3-4dc8-942d-c35507e7ac32 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.034902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.035519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.035853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.036135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.045184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.046544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.056774 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1264/2521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:02.208156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767973-5905-4454-b417-7a0fed99e459 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.217935 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767973-5905-4454-b417-7a0fed99e459 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.221941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.222549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.222830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.223103 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.284189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.285637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f326-269f-4838-97ce-4a025901557b service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.295676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1258/2522] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:02 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:02.724704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:02.726251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:02.794680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118f6c8-8558-4d0c-961c-a4ab8b16acdf service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:02.800191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:02.800864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.801157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.801564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] PATH_INFO: `/v3/users/2237ab7e83e444f0bad469f8e149b50f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.802799 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2237ab7e83e444f0bad469f8e149b50f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:02.804809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:02.853715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2237ab7e83e444f0bad469f8e149b50f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:02.854270 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2237ab7e83e444f0bad469f8e149b50f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:02.864106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2237ab7e83e444f0bad469f8e149b50f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:02.875193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2237ab7e83e444f0bad469f8e149b50f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:02.892679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2237ab7e83e444f0bad469f8e149b50f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:02.900415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1265/2523] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:02 2022] DELETE /identity/v3/users/2237ab7e83e444f0bad469f8e149b50f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:02.905038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:02.905509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:02.905883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:02.926803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:02.928047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:02.993288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1259/2524] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:03.003949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.005499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:03.104855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c79ba-8fd6-46b3-988d-41b00f299181 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.112356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.113003 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.113293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.113573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.124850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.127432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.138245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1266/2525] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:03.881218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:03.884785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:03.902246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190efd3-1f39-40ae-8e3d-e3cbde64456e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:03.911256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:03.912298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:03.913703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:03.914235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] PATH_INFO: `/v3/projects/f283083e2af54af4a0c8db8a76025e6a` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:03.915997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f283083e2af54af4a0c8db8a76025e6a)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:03.918140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:03.920227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:04.002248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f283083e2af54af4a0c8db8a76025e6a', 'request_id': 'req-e5bd706c-d637-4395-be71-3bb5d054f64f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.012806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f283083e2af54af4a0c8db8a76025e6a', 'request_id': 'req-e5bd706c-d637-4395-be71-3bb5d054f64f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.022230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f283083e2af54af4a0c8db8a76025e6a', 'request_id': 'req-e5bd706c-d637-4395-be71-3bb5d054f64f'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.037402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] The token cache is being invalidate because project f283083e2af54af4a0c8db8a76025e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:04.037906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.038989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.043998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1260/2526] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:03 2022] DELETE /identity/v3/projects/f283083e2af54af4a0c8db8a76025e6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:04.044638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.056381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53976749-14a2-4785-a0ad-f2f488ee4717 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.065812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:04.121606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.122137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.122586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.123035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] PATH_INFO: `/v3/users/aa93a1910dd24656810870845583180d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.124259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa93a1910dd24656810870845583180d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.126422 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.182456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa93a1910dd24656810870845583180d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.183136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa93a1910dd24656810870845583180d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.191507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa93a1910dd24656810870845583180d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.199797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa93a1910dd24656810870845583180d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.213810 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-726be3e7-9ada-491c-a558-2c73e336c5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa93a1910dd24656810870845583180d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.220880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1267/2527] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:04 2022] DELETE /identity/v3/users/aa93a1910dd24656810870845583180d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:04.524520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.526536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:04.541291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd706c-d637-4395-be71-3bb5d054f64f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.603801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.604587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.604943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.605315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] PATH_INFO: `/v3/projects/2a48534e36984c3d987dc0ed91931f79` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.606598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a48534e36984c3d987dc0ed91931f79)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.608635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.664017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a48534e36984c3d987dc0ed91931f79', 'request_id': 'req-447e72f8-3000-440b-9689-d32c7cf9516e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.677776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a48534e36984c3d987dc0ed91931f79', 'request_id': 'req-447e72f8-3000-440b-9689-d32c7cf9516e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.684227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a48534e36984c3d987dc0ed91931f79', 'request_id': 'req-447e72f8-3000-440b-9689-d32c7cf9516e'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.697668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] The token cache is being invalidate because project 2a48534e36984c3d987dc0ed91931f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:04.698077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.698695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-447e72f8-3000-440b-9689-d32c7cf9516e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:04.700263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1261/2528] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:04 2022] DELETE /identity/v3/projects/2a48534e36984c3d987dc0ed91931f79 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:04.706700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.706928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.707219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.728700 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:04.730061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:04.799083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1268/2529] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:04.807017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.807316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.807600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.835393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:04.836793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:04.846604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1262/2530] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:04.850462 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.862144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055f96-489a-4f9a-801a-4e1baa9f0529 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.867273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.868055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.868843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.868843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.869580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:04.869971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.871925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.887099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1269/2531] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:04.891533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.902295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84557cbf-8e10-451a-a994-3db71b1b4b32 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.907466 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:04.909277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:04.909277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:04.909277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:04.909664 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:04.912918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:04.926508 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:04.948088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1263/2532] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:04 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:04.952854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:04.964399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc92b07-0330-45ef-b681-534707312c30 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:04.989675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.044406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.045540 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.046144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.046255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.046888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.049685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.078198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1270/2533] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:04 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:05.082648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.099412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddd86e-154c-409c-b27a-92de45411fb4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.108478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.109218 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.110252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.110861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.112522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.115700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.131379 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1264/2534] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:05.135441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.149622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339fb67-c526-4a77-be96-a4a8027922a0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.155351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.156073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.156360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.156678 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.157523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.158962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d2cf0-425d-4070-8938-706eb41b9aa6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.171630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1271/2535] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:05.175851 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.189278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a1782-99a3-49fe-8649-a1783790bd70 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.195353 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.196341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.196960 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.197470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] PATH_INFO: `/v3/projects/9426a3073f574034a6abf2369d786437/users/6ecbc71ed15c4da5a3ace440c7d4dc56/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.219474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9426a3073f574034a6abf2369d786437, user_id=6ecbc71ed15c4da5a3ace440c7d4dc56, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.222615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.238432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1265/2536] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:05 2022] PUT /identity/v3/projects/9426a3073f574034a6abf2369d786437/users/6ecbc71ed15c4da5a3ace440c7d4dc56/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:05.249453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.249743 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.250215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.287512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] MFA Rules not processed for user `6ecbc71ed15c4da5a3ace440c7d4dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:05.288797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:05.390403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.392559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1272/2537] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:05.484366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6bc67-85fe-4b10-9100-3dc5cba6c22b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.493885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.496998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.496998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.496998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.496998 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.497599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.540529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1266/2538] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:05.541786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.554120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ffde-7519-44eb-bc97-34be08f536d5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.615236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.615899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.616182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.616453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.617142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.619142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.642731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1273/2539] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:05.644120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.655207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5fc2-3502-4e57-8278-66367c774638 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.660177 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.660795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.661075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.661349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.662084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.663859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.675636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1267/2540] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:05.680267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.690845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde5e5-3e80-4c95-84af-95c6044c31bd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.700255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.700933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.701219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.701499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.702198 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.703916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf6bb-caac-454a-b8fd-a752e0b9101d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.715326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1274/2541] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:05.719700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.730598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2795435-fe5e-489d-b640-f81377b6165e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.736758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.737403 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.737689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.737981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] PATH_INFO: `/v3/projects/93f22d698bc2473d989b6432ec853ab6/users/a3223618ec41458ca435b10a28ea7a51/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.754650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f22d698bc2473d989b6432ec853ab6, user_id=a3223618ec41458ca435b10a28ea7a51, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.757433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.770295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1268/2542] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:05 2022] PUT /identity/v3/projects/93f22d698bc2473d989b6432ec853ab6/users/a3223618ec41458ca435b10a28ea7a51/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:05.782225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.782512 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.782827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.798541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.814076 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] MFA Rules not processed for user `a3223618ec41458ca435b10a28ea7a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:05.815327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:05.878153 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1275/2543] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:05.882813 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.944307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad2f2-f1e4-41fc-b02e-6a5fa125dd2c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:05.948933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:05.949540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:05.949827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:05.950109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:05.950774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:05.952738 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:05.963696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:05.980139 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1269/2544] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:05.984181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:05.995231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fac93-f87b-496d-b56b-924e125cab12 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.050442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.051073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.051323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.051598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.052297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.054223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.082549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1276/2545] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:05 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:06.086479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.097418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7846fad-f003-4627-af4e-52898a9a7e0f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.102254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.103028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.103319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.103681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.104548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.106185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.117277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1270/2546] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:06.121673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.131522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57207c-a3a3-4813-a60b-056e2cfda498 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.136106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.136779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.137057 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.137331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] PATH_INFO: `/v3/projects/8dc35dcff88e43c8a01c4568ace52daa/users/e90500d54f654f5fb28220cb6b4493c4/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.153159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc35dcff88e43c8a01c4568ace52daa, user_id=e90500d54f654f5fb28220cb6b4493c4, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.156164 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.170121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1277/2547] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:06 2022] PUT /identity/v3/projects/8dc35dcff88e43c8a01c4568ace52daa/users/e90500d54f654f5fb28220cb6b4493c4/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:06.174675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.184547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0abd0f-f9bb-4d19-b8d7-78d567aea22e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.243599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.244196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.244827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.245115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.245819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.247424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5310f7-8ed6-4f20-8148-b5375fd65ebc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.260835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1271/2548] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:06.262248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.273414 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9dde8-838c-412d-9d2a-5d82691fca83 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.279167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.279857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.280144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.280445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] PATH_INFO: `/v3/projects/8dc35dcff88e43c8a01c4568ace52daa/users/e90500d54f654f5fb28220cb6b4493c4/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.283201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc35dcff88e43c8a01c4568ace52daa, user_id=e90500d54f654f5fb28220cb6b4493c4, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.285881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.297041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1278/2549] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:06 2022] PUT /identity/v3/projects/8dc35dcff88e43c8a01c4568ace52daa/users/e90500d54f654f5fb28220cb6b4493c4/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:06.307307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.307599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.307923 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.345588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] MFA Rules not processed for user `e90500d54f654f5fb28220cb6b4493c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:06.346889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:06.420473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1272/2550] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:06.432192 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.433898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:06.494567 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.498277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4be05-db7a-4342-80a5-d8424ef3b254 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.503598 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.504251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.504530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.504800 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.514267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.516316 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.529247 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1279/2551] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:06.582497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:06.592489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42163b-c12a-40f7-8449-14cd09fac670 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:06.596919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:06.597541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:06.597852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:06.598129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:06.657756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:06.659423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:06.664410 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:06.669834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1273/2552] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:08.079789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.080646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.104368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.105840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.163713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4aa52-9e21-48da-872b-1845bd4104ab service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.168338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.169042 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.169322 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.169792 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] PATH_INFO: `/v3/users/490301173b0e406cb3dcac8c6dc08bdd` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.171194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490301173b0e406cb3dcac8c6dc08bdd)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.174001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.183686 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95474a-cb8b-40c4-a97d-11bf2d32f986 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.188546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.189286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.189608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.189983 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.192027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.206848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.209062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae5d93-aa9f-4da0-9516-f0164abc00b5 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.223295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1274/2553] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:08.237500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490301173b0e406cb3dcac8c6dc08bdd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.238869 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490301173b0e406cb3dcac8c6dc08bdd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.248154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490301173b0e406cb3dcac8c6dc08bdd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.256504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490301173b0e406cb3dcac8c6dc08bdd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.270134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490301173b0e406cb3dcac8c6dc08bdd'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.277363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1280/2554] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:08 2022] DELETE /identity/v3/users/490301173b0e406cb3dcac8c6dc08bdd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:08.282958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.283319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.283527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.309938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:08.309938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.384185 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1275/2555] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:08.395491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.397553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.476156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd5d8f-e82b-426e-afc6-584af8cd4a59 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.480966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.481834 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.482200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.482533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.494297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.495852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.511945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1281/2556] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:08.811319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.813210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:08.826536 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46084d41-669d-4199-b730-d7a7f056b4ca None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.832249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.832909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.833223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.833503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] PATH_INFO: `/v3/projects/4c8e4313caaa4c5ebe641a73d1242524` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.834722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e4313caaa4c5ebe641a73d1242524)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.836694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:08.886814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e4313caaa4c5ebe641a73d1242524', 'request_id': 'req-e036175b-0ad3-4a06-9c5a-5b996c036975'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.895446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e4313caaa4c5ebe641a73d1242524', 'request_id': 'req-e036175b-0ad3-4a06-9c5a-5b996c036975'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.901679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e4313caaa4c5ebe641a73d1242524', 'request_id': 'req-e036175b-0ad3-4a06-9c5a-5b996c036975'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.913292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] The token cache is being invalidate because project 4c8e4313caaa4c5ebe641a73d1242524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:08.913787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.914456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:08.916091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1276/2557] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:08 2022] DELETE /identity/v3/projects/4c8e4313caaa4c5ebe641a73d1242524 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:08.920361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:08.929991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d158b-f27f-4d74-aac6-0b366f5a6d01 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:08.939361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:08.989806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:08.990452 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:08.990769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:08.991026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] PATH_INFO: `/v3/users/fa9b6daf620b41508c2379fbefad9af6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:08.992361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9b6daf620b41508c2379fbefad9af6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:08.994306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.044356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9b6daf620b41508c2379fbefad9af6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.045028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9b6daf620b41508c2379fbefad9af6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.053010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9b6daf620b41508c2379fbefad9af6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.060188 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9b6daf620b41508c2379fbefad9af6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.074000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9b6daf620b41508c2379fbefad9af6'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.082723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1282/2558] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:08 2022] DELETE /identity/v3/users/fa9b6daf620b41508c2379fbefad9af6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:09.588707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.590214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:09.604146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036175b-0ad3-4a06-9c5a-5b996c036975 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.632989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.693609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.694290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.694631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.695125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] PATH_INFO: `/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.696454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d1ccf7338e4225b8deee26b7ff65ba)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.698451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.739993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.742034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:09.753284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d1ccf7338e4225b8deee26b7ff65ba', 'request_id': 'req-198190f9-1165-49ca-914f-b581debe7d10'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.758424 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3229-c93b-4e74-8365-ace13330822b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.762126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d1ccf7338e4225b8deee26b7ff65ba', 'request_id': 'req-198190f9-1165-49ca-914f-b581debe7d10'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.773512 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d1ccf7338e4225b8deee26b7ff65ba', 'request_id': 'req-198190f9-1165-49ca-914f-b581debe7d10'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.786162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] The token cache is being invalidate because project b3d1ccf7338e4225b8deee26b7ff65ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:09.786453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.787120 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-198190f9-1165-49ca-914f-b581debe7d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.788901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1277/2559] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:09 2022] DELETE /identity/v3/projects/b3d1ccf7338e4225b8deee26b7ff65ba => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:09.793537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e57d9-f61a-44db-8d11-cc4381062e07 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.793829 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e57d9-f61a-44db-8d11-cc4381062e07 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.794109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e57d9-f61a-44db-8d11-cc4381062e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.816651 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a46e57d9-f61a-44db-8d11-cc4381062e07 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:09.817858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a46e57d9-f61a-44db-8d11-cc4381062e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:09.830513 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:09.831468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.831768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.832238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] PATH_INFO: `/v3/users/6ecbc71ed15c4da5a3ace440c7d4dc56` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.833569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecbc71ed15c4da5a3ace440c7d4dc56)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:09.835734 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:09.881605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:09.887913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1278/2560] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:09.895445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.895733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.896055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.904722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecbc71ed15c4da5a3ace440c7d4dc56'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.905815 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecbc71ed15c4da5a3ace440c7d4dc56'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.915860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecbc71ed15c4da5a3ace440c7d4dc56'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.921575 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:09.922842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:09.927627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecbc71ed15c4da5a3ace440c7d4dc56'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.931997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1279/2561] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:09.936147 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:09.946039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-585d3cb4-c574-4aac-ba8f-995a96807597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecbc71ed15c4da5a3ace440c7d4dc56'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:09.951821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d64e8-ffad-42de-b0c2-950971a14b5a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:09.956359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1283/2562] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:09 2022] DELETE /identity/v3/users/6ecbc71ed15c4da5a3ace440c7d4dc56 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:09.957870 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:09.958613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:09.959344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:09.983370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:09.985518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.033532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.051363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.052654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.053122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.053409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.054126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:10.054433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.056938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.077362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1284/2563] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:10.078521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.083900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1280/2564] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:10.084881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.086625 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.089147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e4871-ddf0-4abc-ad4f-f01fb7815215 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.094780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.095479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.095773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.096351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.097092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.099213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.132062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1285/2565] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:10 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:10.135808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.175652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d264e-79f9-446e-834a-0a302ee5dbcd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.204820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5be1a-0959-491a-891a-70abde212fe7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.225028 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.225873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.227905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.228201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.233451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.236185 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.287541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1286/2566] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:10 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:10.287714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.287714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.287714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.287714 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.288663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.301434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc080099-ffe6-429b-9107-33a4fd2cd6b1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.307168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.308962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.310051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.311955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.312244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.314380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.318492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.322112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1281/2567] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:10.322898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.338693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1287/2568] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:10.342798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.353931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf73b2-4082-4c09-9ec5-1b93d105dc1b service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.360049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.360679 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.360958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.361235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.361945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.364372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14edeaf-da99-40ae-89e1-ebd5ec6f2f9e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.384071 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1282/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:10.385309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.429444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448138-381f-4210-8d6c-d5a2fe66f84b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.436249 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.437134 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.437428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.437735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] PATH_INFO: `/v3/projects/1c5616d8b58b484f8e0c8635accc3e11/users/6afc5d02f4b342f597558b09ea8540eb/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.445221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.476171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5616d8b58b484f8e0c8635accc3e11, user_id=6afc5d02f4b342f597558b09ea8540eb, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.480123 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.512427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1288/2570] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:10 2022] PUT /identity/v3/projects/1c5616d8b58b484f8e0c8635accc3e11/users/6afc5d02f4b342f597558b09ea8540eb/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:10.523382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.523985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.524271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.662077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] MFA Rules not processed for user `6afc5d02f4b342f597558b09ea8540eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:10.663497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.735273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.737039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.785726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1283/2571] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:10.797325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.799315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:10.839801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:10.848603 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c0bed-da6f-4118-9e41-a0ec15e87a3c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.854767 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.855483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.855858 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.856204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] PATH_INFO: `/v3/projects/9426a3073f574034a6abf2369d786437` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.857460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9426a3073f574034a6abf2369d786437)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.859438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.879965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67019c79-b6dc-49fd-aaa6-2982fcfbee46 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:10.885159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:10.886408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:10.886830 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:10.887192 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:10.897526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:10.900109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:10.910568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1284/2572] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:10.912623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9426a3073f574034a6abf2369d786437', 'request_id': 'req-3835e16b-5fc0-41fa-bcba-7737d59c6a36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:10.921821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9426a3073f574034a6abf2369d786437', 'request_id': 'req-3835e16b-5fc0-41fa-bcba-7737d59c6a36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:10.929157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9426a3073f574034a6abf2369d786437', 'request_id': 'req-3835e16b-5fc0-41fa-bcba-7737d59c6a36'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:10.945273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] The token cache is being invalidate because project 9426a3073f574034a6abf2369d786437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:10.945965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:10.948168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:10.949862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1289/2573] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:10 2022] DELETE /identity/v3/projects/9426a3073f574034a6abf2369d786437 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:10.954470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:10.970183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0884d-e1b3-4e44-b75a-b9cfb66951e5 service glance] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.063787 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.064389 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.064776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.065160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] PATH_INFO: `/v3/users/a3223618ec41458ca435b10a28ea7a51` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.067015 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3223618ec41458ca435b10a28ea7a51)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.069644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.146698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3223618ec41458ca435b10a28ea7a51'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.147711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3223618ec41458ca435b10a28ea7a51'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.155336 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3223618ec41458ca435b10a28ea7a51'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.165476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3223618ec41458ca435b10a28ea7a51'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.166511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3223618ec41458ca435b10a28ea7a51'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.187143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1285/2574] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:10 2022] DELETE /identity/v3/users/a3223618ec41458ca435b10a28ea7a51 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:11.570623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.574396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:11.594413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.596098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:11.607968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e16b-5fc0-41fa-bcba-7737d59c6a36 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.700366 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.706016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.707027 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.708576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.709046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] PATH_INFO: `/v3/projects/93f22d698bc2473d989b6432ec853ab6` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.712627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f22d698bc2473d989b6432ec853ab6)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.715246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.736601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b266b12-5c97-49e1-8d73-2cc0321c4954 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.743524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.744358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.745847 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.746254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] PATH_INFO: `/v3/users/0c2d8f9464e042729270126f3ca04626` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.748330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2d8f9464e042729270126f3ca04626)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.750704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:11.758877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:11.799009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f22d698bc2473d989b6432ec853ab6', 'request_id': 'req-0beb566e-5485-42cd-a7cc-3b6533af4839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.816259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f22d698bc2473d989b6432ec853ab6', 'request_id': 'req-0beb566e-5485-42cd-a7cc-3b6533af4839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.827139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f22d698bc2473d989b6432ec853ab6', 'request_id': 'req-0beb566e-5485-42cd-a7cc-3b6533af4839'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.843727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] The token cache is being invalidate because project 93f22d698bc2473d989b6432ec853ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:11.844675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.845673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.851210 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1290/2575] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:11 2022] DELETE /identity/v3/projects/93f22d698bc2473d989b6432ec853ab6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:11.852719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:11.854399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:11.858792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2d8f9464e042729270126f3ca04626'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.862065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2d8f9464e042729270126f3ca04626'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.885498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2d8f9464e042729270126f3ca04626'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.919173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2d8f9464e042729270126f3ca04626'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.920898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-78362bf1-5933-4948-88f9-771e4f273556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2d8f9464e042729270126f3ca04626'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:11.966664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb566e-5485-42cd-a7cc-3b6533af4839 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:11.975547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1286/2576] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:11 2022] DELETE /identity/v3/users/0c2d8f9464e042729270126f3ca04626 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:11.977016 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.977301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.977590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.978597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:11.979264 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:11.979547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:11.979862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] PATH_INFO: `/v3/users/e90500d54f654f5fb28220cb6b4493c4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:11.981220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90500d54f654f5fb28220cb6b4493c4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:11.984342 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.028556 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:12.030473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.060216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90500d54f654f5fb28220cb6b4493c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.060946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90500d54f654f5fb28220cb6b4493c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.072704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90500d54f654f5fb28220cb6b4493c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.097011 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90500d54f654f5fb28220cb6b4493c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.115193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90500d54f654f5fb28220cb6b4493c4'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.130618 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1291/2577] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:11 2022] DELETE /identity/v3/users/e90500d54f654f5fb28220cb6b4493c4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:12.144210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1287/2578] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:12.259434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.264857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.312167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.322344 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.332766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.354527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc134a25-a317-4a13-ad8f-30c3f527b1a4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.358940 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a38fe-f566-4af3-b7b0-0dca8e2a8f32 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.363622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.364765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.365380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.365797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.464211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.464891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.465172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.465463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] PATH_INFO: `/v3/users/236a8fb93bae48dd82086f1f35d1fdba` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.468731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=236a8fb93bae48dd82086f1f35d1fdba)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.470256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.475262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.475866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:12.477875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.510475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1292/2579] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:12.520033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.521963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.542026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75faf8-3c5b-46cf-8ce5-ad041a0ce05e service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.554437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.555110 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.555393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.555806 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] PATH_INFO: `/v3/projects/8dc35dcff88e43c8a01c4568ace52daa` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.557233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc35dcff88e43c8a01c4568ace52daa)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.559428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.570390 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236a8fb93bae48dd82086f1f35d1fdba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.572927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236a8fb93bae48dd82086f1f35d1fdba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.596753 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236a8fb93bae48dd82086f1f35d1fdba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.608561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236a8fb93bae48dd82086f1f35d1fdba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.610043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-94ca5026-74bc-45ed-8780-920c7dc442ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236a8fb93bae48dd82086f1f35d1fdba'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.626453 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc35dcff88e43c8a01c4568ace52daa', 'request_id': 'req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.634716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc35dcff88e43c8a01c4568ace52daa', 'request_id': 'req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.639783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1288/2580] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:12 2022] DELETE /identity/v3/users/236a8fb93bae48dd82086f1f35d1fdba => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:12.646353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc35dcff88e43c8a01c4568ace52daa', 'request_id': 'req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.659162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] The token cache is being invalidate because project 8dc35dcff88e43c8a01c4568ace52daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:12.659520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.664174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a7d2c9c1-c033-4c6e-ba23-d10b0f47a362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:12.666177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1293/2581] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:12 2022] DELETE /identity/v3/projects/8dc35dcff88e43c8a01c4568ace52daa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:12.672596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.672971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.673325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.699405 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:12.700845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.782636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1289/2582] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:12.791732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.792229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.792591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.830872 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:12.831446 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.847085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1294/2583] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:12.851563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.867877 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c9752-e684-4183-b6f4-9d616095b7ef None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.873085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.873982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.874264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.874541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.875396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:12.875626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.878000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.893918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1290/2584] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:12.899161 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.906770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.912273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:12.926200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f336-f095-490f-a9e0-26a4ffedb3ab None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.933086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c4d1-6e3a-4191-8f15-1c2e3c21d23a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:12.936032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.937315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.937625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.937946 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.939597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.942367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.948031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:12.948791 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:12.949104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:12.949531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] PATH_INFO: `/v3/projects/7783ac445eb8432e8e91010b40570e71` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:12.951112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7783ac445eb8432e8e91010b40570e71)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:12.953412 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:12.981554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1295/2585] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:12 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:12.982997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:12.988750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.014457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7783ac445eb8432e8e91010b40570e71', 'request_id': 'req-e92c020e-e7cf-411e-9838-9630ccc035cc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.024648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.025502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7783ac445eb8432e8e91010b40570e71', 'request_id': 'req-e92c020e-e7cf-411e-9838-9630ccc035cc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.033324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7783ac445eb8432e8e91010b40570e71', 'request_id': 'req-e92c020e-e7cf-411e-9838-9630ccc035cc'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.034579 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.051687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] The token cache is being invalidate because project 7783ac445eb8432e8e91010b40570e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:13.052040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.052703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.054424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1291/2586] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:12 2022] DELETE /identity/v3/projects/7783ac445eb8432e8e91010b40570e71 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:13.055333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.056634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.064845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b629c4e-9498-4ea2-a3f2-1373a81de246 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.125059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c020e-e7cf-411e-9838-9630ccc035cc admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.127441 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.128121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.128399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.128674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] PATH_INFO: `/v3/projects/1139f2b053a743ada79cf22446a95e6f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.129953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1139f2b053a743ada79cf22446a95e6f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.130549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.131173 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.131458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.131736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.131919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.132437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.134388 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8db5b6-b133-4a79-bed9-ab09dff53f0e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.158325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1292/2587] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:13.158325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c50-8c0a-4172-9577-58abba8ed8ae None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.158325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c50-8c0a-4172-9577-58abba8ed8ae None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.158325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c50-8c0a-4172-9577-58abba8ed8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.182514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0a473c50-8c0a-4172-9577-58abba8ed8ae None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:13.183778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0a473c50-8c0a-4172-9577-58abba8ed8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.190890 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1139f2b053a743ada79cf22446a95e6f', 'request_id': 'req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.201591 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1139f2b053a743ada79cf22446a95e6f', 'request_id': 'req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.210352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1139f2b053a743ada79cf22446a95e6f', 'request_id': 'req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.223269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] The token cache is being invalidate because project 1139f2b053a743ada79cf22446a95e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:13.223610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.224293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:13.225829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1296/2588] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:12 2022] DELETE /identity/v3/projects/1139f2b053a743ada79cf22446a95e6f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:13.226665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.227993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.265549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1293/2589] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:13.273317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.273609 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.273886 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.304703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:13.306050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.316951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1294/2590] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:13.321082 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.335563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e614b6-35e9-467b-baf3-60be17e81942 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.344092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010aa8-9ecf-4618-b3da-c815b0bdbd90 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.345563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.346223 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.346505 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.346783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.347857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:13.348156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.349106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.349854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.350193 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.350302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.350554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.351362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.353407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.367993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1297/2591] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:13.371926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.372416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1295/2592] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:13.376801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.381373 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.389673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b45ad-c8e7-4b26-bc43-454c4710454c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.391293 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f797-c7e0-459c-9a22-2c122c44f029 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.402680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.403431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.404168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.404311 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.404646 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.404961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.405246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.405523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.405765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.406750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.408252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.414341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.420051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1298/2593] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:13.430588 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.449735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f65f-dc2f-4390-b2b5-6e4efad773b6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.465440 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1296/2594] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/projects => generated 355 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:13.466272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.470830 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.471529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.471843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.472163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] PATH_INFO: `/v3/projects/53465b9273364951badfe403d038901c/users/ae798deb341e43d89167c0e83d8ca8c7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.494284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53465b9273364951badfe403d038901c, user_id=ae798deb341e43d89167c0e83d8ca8c7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.497651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfda845-de3f-42b4-bb3a-df625bad1926 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.517586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1299/2595] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:13 2022] PUT /identity/v3/projects/53465b9273364951badfe403d038901c/users/ae798deb341e43d89167c0e83d8ca8c7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:13.523269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.523555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.524225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.527900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.548483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:13.549325 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d8b6-91b6-4817-8266-dc00a9872ddb admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.549581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.608621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.609215 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.610043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.610432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.611206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.613437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.620887 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1300/2596] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:13.631582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.633221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.640373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1297/2597] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/users => generated 278 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:13.644189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.654452 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8563f-12f7-471e-b544-d67ef660a539 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.659624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.660285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.660571 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.660848 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.661546 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.663153 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.673457 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1298/2598] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:13.677315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.687827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6362-8a45-44e2-ada2-7ba7ef2a9be6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.692552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.693169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.693455 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.693732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.694426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.696056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.707086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1299/2599] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:13.708901 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bf6e-45ce-485b-9aa6-f0ced0c6eeb3 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.711164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.712831 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.713503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.713794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.714068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.724518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.724737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceef89-21be-41b6-af60-2d261c815107 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.725965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9cbe9-6add-4f6d-bb65-0e6659a27d10 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.729520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.730191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.730472 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.730749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] PATH_INFO: `/v3/projects/4c3f2424fe474342b8edaeae1c143fd4/users/bb2c319490084308a613c6e63944a6a5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.735763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1301/2600] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:13.745750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f2424fe474342b8edaeae1c143fd4, user_id=bb2c319490084308a613c6e63944a6a5, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.748443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:13.768073 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1300/2601] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:13 2022] PUT /identity/v3/projects/4c3f2424fe474342b8edaeae1c143fd4/users/bb2c319490084308a613c6e63944a6a5/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:13.775163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.775374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.775647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.806245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] MFA Rules not processed for user `bb2c319490084308a613c6e63944a6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:13.807406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:13.879228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:13.883248 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1302/2602] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:13.888063 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:13.964542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581520d-a8d9-419b-9b97-59f810100797 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:13.970494 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:13.971320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:13.971601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:13.971954 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:13.972647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:13.974600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.003861 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1301/2603] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:13 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:14.008241 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.020999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45647f-42f0-4ba1-be90-c4f59e0dac16 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.099310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.100074 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.100427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.100911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.101885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.103919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.129690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1303/2604] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:14.133542 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.145145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e75-949a-459d-be62-c1e964ee3bd0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.150916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.154729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.154729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.154729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.155076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.157133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.176127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1302/2605] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:14.177472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.190375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ec6ad-5355-45de-b402-aefcc46c4da4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.197205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.197949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.198237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.198535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] PATH_INFO: `/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1/users/b5b20cf77a3c4653ad26197b1a7ea4bf/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.216051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d5a2f52ba741b78a1c238d4c38a2b1, user_id=b5b20cf77a3c4653ad26197b1a7ea4bf, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.219295 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.238902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1304/2606] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:14 2022] PUT /identity/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1/users/b5b20cf77a3c4653ad26197b1a7ea4bf/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:14.242621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.253831 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bad526-73e9-408c-aac9-8672b89f670e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.258426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.330863 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.331358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.331989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.332114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.333116 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.334889 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f021e-f5a7-43ae-8823-796c09f6a5d6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.351199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1303/2607] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:14.355679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.366714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da826f-29bd-4026-961d-3133e94092f6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.372197 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.373151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.373434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.373715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] PATH_INFO: `/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1/users/b5b20cf77a3c4653ad26197b1a7ea4bf/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.376689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d5a2f52ba741b78a1c238d4c38a2b1, user_id=b5b20cf77a3c4653ad26197b1a7ea4bf, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.379706 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.393288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1305/2608] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:14 2022] PUT /identity/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1/users/b5b20cf77a3c4653ad26197b1a7ea4bf/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:14.404023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258eae7-ddb2-4733-b1cd-4fef3f356f09 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.404304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258eae7-ddb2-4733-b1cd-4fef3f356f09 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.404583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258eae7-ddb2-4733-b1cd-4fef3f356f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.436763 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2258eae7-ddb2-4733-b1cd-4fef3f356f09 None None] MFA Rules not processed for user `b5b20cf77a3c4653ad26197b1a7ea4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:14.438597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2258eae7-ddb2-4733-b1cd-4fef3f356f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:14.527803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1304/2609] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:14.541530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.543244 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:14.615889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c4183-d6f0-4541-bcf5-197869bc0f9c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.620777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.621418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.621705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.621982 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.636913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.638377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.650760 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1306/2610] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:14.700387 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625937cb-7ead-4093-887f-79966b086074 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.700582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625937cb-7ead-4093-887f-79966b086074 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.701104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625937cb-7ead-4093-887f-79966b086074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.742659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-625937cb-7ead-4093-887f-79966b086074 None None] MFA Rules not processed for user `ae798deb341e43d89167c0e83d8ca8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:14.744018 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-625937cb-7ead-4093-887f-79966b086074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:14.748884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.750300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:14.761597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8121e7-69a1-48c6-9778-b82d9ef3f813 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.766429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.767485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.767485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.769655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.830687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1305/2611] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:14.835270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625937cb-7ead-4093-887f-79966b086074 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.841007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.847454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.849053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.860688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1307/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:14.863456 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:14.921030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625937cb-7ead-4093-887f-79966b086074 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:14.926191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:14.926827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:14.927160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:14.927436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:14.928230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:14.930688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:14.967552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1306/2613] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:14.969204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:14.987407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcded3-700c-4e94-9a1c-4537dd564cb1 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.052427 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.053059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.053340 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.053614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.054275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.056267 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.077621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1308/2614] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:14 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:15.082367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.093049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abd38a-fb45-44d6-89a1-bca20af0df55 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.098696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.099315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.099600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.099916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.100660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.102317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.113678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1307/2615] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:15.118086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.128841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224064bf-8802-4fff-96e7-03b6b22b8cba admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.133945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.134613 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.134897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.135174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] PATH_INFO: `/v3/projects/9bb0eac868c94c17b21a7c053201f759/users/e8c0944afb294db4a0e95524064a95c3/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.151339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb0eac868c94c17b21a7c053201f759, user_id=e8c0944afb294db4a0e95524064a95c3, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.154308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.168934 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1309/2616] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:15 2022] PUT /identity/v3/projects/9bb0eac868c94c17b21a7c053201f759/users/e8c0944afb294db4a0e95524064a95c3/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:15.173295 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.191922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3158a-f544-4aa9-9545-631ebce08775 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.252426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.253064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.253341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.253613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.254304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.255933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb84b79-9c0d-4161-89eb-17aeccb0e159 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.268124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1308/2617] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:15.272240 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:15.282919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fa7c3-86c7-49f0-b26d-2f51da838f22 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:15.287786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:15.288472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.288776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.289117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] PATH_INFO: `/v3/projects/9bb0eac868c94c17b21a7c053201f759/users/e8c0944afb294db4a0e95524064a95c3/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.291335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb0eac868c94c17b21a7c053201f759, user_id=e8c0944afb294db4a0e95524064a95c3, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:15.294058 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf278f-024b-4f80-b632-e29df0b279a7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:15.305221 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1310/2618] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:15 2022] PUT /identity/v3/projects/9bb0eac868c94c17b21a7c053201f759/users/e8c0944afb294db4a0e95524064a95c3/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:15.958322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:15.958866 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:15.958996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:15.988916 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] MFA Rules not processed for user `e8c0944afb294db4a0e95524064a95c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:15.990088 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:16.100091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1309/2619] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:16.105139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.105633 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.105744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.128362 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] MFA Rules not processed for user `ae798deb341e43d89167c0e83d8ca8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:16.129710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:16.214965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1311/2620] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:16.230799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.232668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:16.247971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.309692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8c72-edf7-4f3d-a793-23b41ac86c40 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.316349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.317006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.317294 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.317591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.326743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.329054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.338394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1310/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:16.579205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:16.638843 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9f2c3-ee2e-4868-82fb-2886eee12f9b None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:16.643543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:16.644208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:16.644491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:16.644764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:16.646562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:16.652984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:16.658765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:16.661040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:16.670332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1312/2622] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:22.784288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:22.785733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:22.803534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e001-24d7-4881-b8ae-e10131aa7021 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:22.809119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:22.809725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:22.810005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:22.810280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:22.813602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:22.827160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:22.829300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:22.841285 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1311/2623] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:26.666628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:26.981474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:27.059690 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef095ab-1612-4341-9c5f-4ad89c306aee service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:27.064386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:27.065065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:27.065391 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:27.065740 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:27.077627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:27.079782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9d5a5-e078-499a-b60e-9b53aefa331d service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:27.091720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1313/2624] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:30.131182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.199216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff827498-d229-489d-852f-55e087c19d8c service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.205050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.205735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.206272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.206272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] PATH_INFO: `/v3/users/bb2c319490084308a613c6e63944a6a5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.207540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2c319490084308a613c6e63944a6a5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.209674 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.262828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2c319490084308a613c6e63944a6a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.263510 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2c319490084308a613c6e63944a6a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.271924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2c319490084308a613c6e63944a6a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.280527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2c319490084308a613c6e63944a6a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.281345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2c319490084308a613c6e63944a6a5'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.310180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1312/2625] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:30 2022] DELETE /identity/v3/users/bb2c319490084308a613c6e63944a6a5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:30.315314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.315797 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.315913 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.335578 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:30.336825 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:30.396874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1314/2626] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:30.406869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.408356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:30.415436 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:30.474856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307880-c7a9-4364-b515-33fa0ef7290b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.478495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.479112 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.479393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.479668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.489828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.491869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.506011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1313/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:30.788605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.790052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:30.808854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5a14d-63ba-45f9-837a-195f3c16d62c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.815536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.817338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.817676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.817959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] PATH_INFO: `/v3/projects/4c3f2424fe474342b8edaeae1c143fd4` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.819820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3f2424fe474342b8edaeae1c143fd4)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.823227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:30.876554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3f2424fe474342b8edaeae1c143fd4', 'request_id': 'req-add8c4bf-5368-49c9-b807-55163d45b675'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.885454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3f2424fe474342b8edaeae1c143fd4', 'request_id': 'req-add8c4bf-5368-49c9-b807-55163d45b675'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.891650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3f2424fe474342b8edaeae1c143fd4', 'request_id': 'req-add8c4bf-5368-49c9-b807-55163d45b675'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.903530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] The token cache is being invalidate because project 4c3f2424fe474342b8edaeae1c143fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:30.903937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.904583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:30.906217 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1315/2628] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:30 2022] DELETE /identity/v3/projects/4c3f2424fe474342b8edaeae1c143fd4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:30.911148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:30.923495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad3391-36c6-4599-9ec0-35adab59bf2b service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:30.984743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:30.985584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:30.986002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:30.986328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] PATH_INFO: `/v3/users/b5b20cf77a3c4653ad26197b1a7ea4bf` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:30.987561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b20cf77a3c4653ad26197b1a7ea4bf)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:30.989551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.034834 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b20cf77a3c4653ad26197b1a7ea4bf'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.035478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b20cf77a3c4653ad26197b1a7ea4bf'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.042243 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b20cf77a3c4653ad26197b1a7ea4bf'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.051355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b20cf77a3c4653ad26197b1a7ea4bf'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.052130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3b6fd778-fc74-4a11-8179-d18bd0c35495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b20cf77a3c4653ad26197b1a7ea4bf'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.069726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1314/2629] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:30 2022] DELETE /identity/v3/users/b5b20cf77a3c4653ad26197b1a7ea4bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:31.348450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.350081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:31.365236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c4bf-5368-49c9-b807-55163d45b675 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.393855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:31.445150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.445840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.446199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.446478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] PATH_INFO: `/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.447663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d5a2f52ba741b78a1c238d4c38a2b1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.449635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.504481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d5a2f52ba741b78a1c238d4c38a2b1', 'request_id': 'req-c2c47382-fb8e-48f5-b3a3-66be726c19b8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.512569 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d5a2f52ba741b78a1c238d4c38a2b1', 'request_id': 'req-c2c47382-fb8e-48f5-b3a3-66be726c19b8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.519367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d5a2f52ba741b78a1c238d4c38a2b1', 'request_id': 'req-c2c47382-fb8e-48f5-b3a3-66be726c19b8'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.534178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] The token cache is being invalidate because project 04d5a2f52ba741b78a1c238d4c38a2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:31.534487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.535199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-c2c47382-fb8e-48f5-b3a3-66be726c19b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:31.536744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1316/2630] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:31 2022] DELETE /identity/v3/projects/04d5a2f52ba741b78a1c238d4c38a2b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:31.541766 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.542255 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.542367 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.564039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:31.565262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:31.587378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:31.632272 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1315/2631] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:31.643246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.643547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.643848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.673330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:31.675469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:31.685360 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1317/2632] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:31.690473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.702343 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d763-e7f8-4228-bb66-612d2ad0b688 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.711069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.712163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.713443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.713934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.715362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:31.716060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.719612 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.732441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1316/2633] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:31.738423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.749337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da244-c7e7-44c1-9150-75edd4d2bbc9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.755352 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.756311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.759259 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.759593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.760554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.763065 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.797662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1318/2634] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:31 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:31.802209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.812750 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa4db-48cb-4a29-ac0e-788b35c06fe8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.871373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.872110 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.872396 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.872689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.873381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.875459 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.898595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1317/2635] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:31 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:31.902786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.914303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f98da-05b0-43e2-a4f4-9c01c9e8f480 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.919194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.919902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.920184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.920457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.921157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.922750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.933341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1319/2636] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:31.937427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.948176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a26e11-29bd-450f-80f8-d862216a231b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.953880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.954526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.954815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.955097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:31.956001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:31.957644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd163-6839-4637-bbd7-5aea53f869ac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:31.968898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1318/2637] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:31.973941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:31.985538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50c3c6-8307-49ca-96a1-29d5bda03f22 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:31.991345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:31.992204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:31.992593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:31.992971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] PATH_INFO: `/v3/projects/0901bbf760b240898dc3ebd412aa2255/users/1f89be0923e64ab7ae5103f0f52a5c99/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.009726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0901bbf760b240898dc3ebd412aa2255, user_id=1f89be0923e64ab7ae5103f0f52a5c99, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.012438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.025840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1320/2638] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:31 2022] PUT /identity/v3/projects/0901bbf760b240898dc3ebd412aa2255/users/1f89be0923e64ab7ae5103f0f52a5c99/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:32.039811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.040099 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.040376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.069797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] MFA Rules not processed for user `1f89be0923e64ab7ae5103f0f52a5c99`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:32.071332 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.145928 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1319/2639] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:32.150671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.207190 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.223680 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad7fd-a837-4053-b04d-4649856b5ac5 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.228571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.229152 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.229554 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.229841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.230518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.232487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.260518 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1321/2640] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:32.264709 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.276641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a69f92-3f47-40b8-a0dd-4de2c187953f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.294937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.336358 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.336986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.337268 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.337544 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.338213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.340225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.364658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1320/2641] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:32.369673 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.381599 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601b636-8b6c-4ffc-9255-ca6532e2af48 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.387195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.387987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.388310 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.388626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.389318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.391523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.403612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1322/2642] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:32.407783 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.417801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c40b-94c6-43ac-bc19-79aeec7064b3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.423569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.424372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.424688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.425052 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] PATH_INFO: `/v3/projects/10333a54628248f49e882f4b2a1a27b5/users/9c1223dc359c46e49f44d2c42743fb5f/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.441777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10333a54628248f49e882f4b2a1a27b5, user_id=9c1223dc359c46e49f44d2c42743fb5f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.444933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.461501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1321/2643] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:32 2022] PUT /identity/v3/projects/10333a54628248f49e882f4b2a1a27b5/users/9c1223dc359c46e49f44d2c42743fb5f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:32.465978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.477332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ee728-22a9-4c1d-9aa8-10609d4aa2b0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.534687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.535219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.535503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.535808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.536503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.538091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3835dc-1577-47a5-8037-d7c0be11b9d6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.548431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1323/2644] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:32.552620 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.563952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47104750-2ac6-481f-b970-7c1eeda6b711 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.568654 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.569314 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.569592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.569864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] PATH_INFO: `/v3/projects/10333a54628248f49e882f4b2a1a27b5/users/9c1223dc359c46e49f44d2c42743fb5f/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.571827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10333a54628248f49e882f4b2a1a27b5, user_id=9c1223dc359c46e49f44d2c42743fb5f, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.574454 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.584969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1322/2645] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:32 2022] PUT /identity/v3/projects/10333a54628248f49e882f4b2a1a27b5/users/9c1223dc359c46e49f44d2c42743fb5f/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:32.596261 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.596677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.597085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.628329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] MFA Rules not processed for user `9c1223dc359c46e49f44d2c42743fb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:32.629539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.701140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1324/2646] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:32.714123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.715882 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.777402 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972c65d-06f2-45c2-97cd-e0c888e3c21b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.781585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.782209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.782521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.782802 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.792650 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.794105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.805263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1323/2647] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:32.839219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.859119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:32.864925 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:32.900499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.919899 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40b72e-2aa0-4373-b17e-634a13e5a7a1 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.925393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.926069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.926353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.926627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] PATH_INFO: `/v3/users/1f89be0923e64ab7ae5103f0f52a5c99` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.927888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f89be0923e64ab7ae5103f0f52a5c99)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.929880 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.956687 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06374b1-6921-404f-98b8-da952ed2d68e service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:32.964601 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:32.965426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:32.965796 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:32.966155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] PATH_INFO: `/v3/users/6afc5d02f4b342f597558b09ea8540eb` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:32.967429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afc5d02f4b342f597558b09ea8540eb)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:32.970012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:32.995309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f89be0923e64ab7ae5103f0f52a5c99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:32.996006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:32.996537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f89be0923e64ab7ae5103f0f52a5c99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.013389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f89be0923e64ab7ae5103f0f52a5c99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.023293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f89be0923e64ab7ae5103f0f52a5c99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.035632 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afc5d02f4b342f597558b09ea8540eb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.036397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afc5d02f4b342f597558b09ea8540eb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.044956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-210a555e-3040-470a-8fb1-d4441df31c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f89be0923e64ab7ae5103f0f52a5c99'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.046256 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afc5d02f4b342f597558b09ea8540eb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.055504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1325/2648] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:32 2022] DELETE /identity/v3/users/1f89be0923e64ab7ae5103f0f52a5c99 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:33.060707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.061143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.061296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afc5d02f4b342f597558b09ea8540eb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.061617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.062105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-56430a6d-3b87-4059-8b63-c7608785e129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afc5d02f4b342f597558b09ea8540eb'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.080889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.081995 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1324/2649] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:32 2022] DELETE /identity/v3/users/6afc5d02f4b342f597558b09ea8540eb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:33.082135 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.086585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.087062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.087335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.109841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.111146 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.149146 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1326/2650] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:33.159970 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.161404 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.180788 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1325/2651] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:33.191145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.192534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.229651 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086890-b311-4435-a1aa-97bdf157af12 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.234169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.234855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.235204 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.235583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.247468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.249010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.259348 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1327/2652] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:33.262331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed39324-8ca9-414f-ac43-219a090ebec6 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.266183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.267523 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.267841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.268126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.279602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.281182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.291067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1326/2653] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:33.548455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.550266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.576215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58941-58a8-42e4-93f3-bba87e69676f service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.582485 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.583130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.583409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.583681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] PATH_INFO: `/v3/projects/0901bbf760b240898dc3ebd412aa2255` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.585349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0901bbf760b240898dc3ebd412aa2255)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.588328 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.597137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.601157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.602970 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.620354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470936a-f47f-4a98-9e76-56f1fa100dbf service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.626209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.626872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.627282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.627479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] PATH_INFO: `/v3/projects/1c5616d8b58b484f8e0c8635accc3e11` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.628821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5616d8b58b484f8e0c8635accc3e11)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.630645 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.648787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0901bbf760b240898dc3ebd412aa2255', 'request_id': 'req-66873163-9609-47de-ab93-2f2aef94d07e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.657212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0901bbf760b240898dc3ebd412aa2255', 'request_id': 'req-66873163-9609-47de-ab93-2f2aef94d07e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.664037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0901bbf760b240898dc3ebd412aa2255', 'request_id': 'req-66873163-9609-47de-ab93-2f2aef94d07e'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.670938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.677041 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] The token cache is being invalidate because project 0901bbf760b240898dc3ebd412aa2255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:33.677333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.678048 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.679776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1328/2654] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:33 2022] DELETE /identity/v3/projects/0901bbf760b240898dc3ebd412aa2255 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:33.682980 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5616d8b58b484f8e0c8635accc3e11', 'request_id': 'req-0ff50992-b18d-4899-98fc-783f842761c7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.683643 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.685199 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.692126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5616d8b58b484f8e0c8635accc3e11', 'request_id': 'req-0ff50992-b18d-4899-98fc-783f842761c7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.698036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5616d8b58b484f8e0c8635accc3e11', 'request_id': 'req-0ff50992-b18d-4899-98fc-783f842761c7'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.710036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] The token cache is being invalidate because project 1c5616d8b58b484f8e0c8635accc3e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:33.710265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.710924 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0ff50992-b18d-4899-98fc-783f842761c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.712526 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1327/2655] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:33 2022] DELETE /identity/v3/projects/1c5616d8b58b484f8e0c8635accc3e11 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:33.717338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe9ca-c004-4b8d-8829-3618028dcaad None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.717630 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe9ca-c004-4b8d-8829-3618028dcaad None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.717912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffe9ca-c004-4b8d-8829-3618028dcaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.740092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d2ffe9ca-c004-4b8d-8829-3618028dcaad None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.741300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d2ffe9ca-c004-4b8d-8829-3618028dcaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.753877 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66873163-9609-47de-ab93-2f2aef94d07e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.802816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1328/2656] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:33.810707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.810989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.811278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.814939 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.815584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.815902 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.816178 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] PATH_INFO: `/v3/users/9c1223dc359c46e49f44d2c42743fb5f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.817363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1223dc359c46e49f44d2c42743fb5f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.819281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.832019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:33.833232 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.842038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1329/2657] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:33.846347 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.856310 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1931d-9a73-43c1-b5c7-4a555833abb9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.861250 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.861881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.862167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.862648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.863145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:33.863487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.865131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.869345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:33.872439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1223dc359c46e49f44d2c42743fb5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.874144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1223dc359c46e49f44d2c42743fb5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.880748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1330/2658] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:33.884227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1223dc359c46e49f44d2c42743fb5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.885371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:33.887600 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:33.892521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1223dc359c46e49f44d2c42743fb5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.901986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f28e4-e41c-494c-8753-59db5c94505a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:33.905640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1223dc359c46e49f44d2c42743fb5f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:33.907384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:33.908055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:33.908329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:33.908608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:33.909279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:33.911205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:33.912147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1329/2659] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:33 2022] DELETE /identity/v3/users/9c1223dc359c46e49f44d2c42743fb5f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:33.940513 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1331/2660] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:33.944686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.010580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15607-cd40-4802-a15d-34dcf436b6d0 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.070214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.070973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.071113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.071386 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.072100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.074039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.110670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1330/2661] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:33 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:34.115066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.129349 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08f8ae-4c16-432f-bc82-85621893ff84 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.135668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.136564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.137235 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.137794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.140643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.142433 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.160647 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1332/2662] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:34.161541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.173489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b579-1edb-42fd-bb6b-1bfdd9dc4fdd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.178350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.178998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.179285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.179564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.180376 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.181995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.193434 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1331/2663] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:34.198054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.213309 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c3db-c1c3-4256-87e2-af9010e66e5a admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.219182 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.220055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.220406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.220693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] PATH_INFO: `/v3/projects/2a205105b55d4b81aedbd89ae192467f/users/1ff85ad5c241483487fd3a76d6e188b7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.234719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.237926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.245901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a205105b55d4b81aedbd89ae192467f, user_id=1ff85ad5c241483487fd3a76d6e188b7, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.249035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f8047-f51c-4b52-af91-ffd711cf998d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.259737 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b37e0d-16d3-41b4-957a-b501cc4b6944 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.282818 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1333/2664] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:34 2022] PUT /identity/v3/projects/2a205105b55d4b81aedbd89ae192467f/users/1ff85ad5c241483487fd3a76d6e188b7/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:34.294964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.295260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.295541 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.328745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.336022 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] MFA Rules not processed for user `1ff85ad5c241483487fd3a76d6e188b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:34.337114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.351719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.352620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.352951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.353232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] PATH_INFO: `/v3/projects/10333a54628248f49e882f4b2a1a27b5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.354668 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10333a54628248f49e882f4b2a1a27b5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.357298 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.377666 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.417514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1334/2665] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:34.428631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.430058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.464054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10333a54628248f49e882f4b2a1a27b5', 'request_id': 'req-a6d98dd4-2f67-41c6-bbb9-5140638c876a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:34.478311 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10333a54628248f49e882f4b2a1a27b5', 'request_id': 'req-a6d98dd4-2f67-41c6-bbb9-5140638c876a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:34.485828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10333a54628248f49e882f4b2a1a27b5', 'request_id': 'req-a6d98dd4-2f67-41c6-bbb9-5140638c876a'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:34.498998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] The token cache is being invalidate because project 10333a54628248f49e882f4b2a1a27b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:34.499403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:34.500133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a6d98dd4-2f67-41c6-bbb9-5140638c876a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:34.501795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1332/2666] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:34 2022] DELETE /identity/v3/projects/10333a54628248f49e882f4b2a1a27b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:34.507847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272703-8c4d-4ef8-9185-2045cd6d27dc None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.508117 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c0f59-b42b-4c1d-97cd-e3d680db536b None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.508251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272703-8c4d-4ef8-9185-2045cd6d27dc None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.508568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272703-8c4d-4ef8-9185-2045cd6d27dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.528889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-97272703-8c4d-4ef8-9185-2045cd6d27dc None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:34.530085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-97272703-8c4d-4ef8-9185-2045cd6d27dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.562716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.563342 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.563628 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.563938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.565739 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.600038 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1333/2667] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:34.607318 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.607728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.608046 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.627300 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.627919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:34.628822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.629080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:34.636984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1334/2668] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:34.637809 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1335/2669] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:34.641258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.651381 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed561e2-2509-49ba-afb5-c1574575f68c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.658282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.658931 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.659215 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.659579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.660396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:34.660750 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.662593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.675709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1335/2670] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:34.680074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.693676 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b887-e62c-46f7-94e5-caf1e8e89e00 service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.698374 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.698982 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.699260 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.699586 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.700419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.702922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.732852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1336/2671] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:34.737009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.747066 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df4ca-ed3f-470f-a7c6-5fb916c364f8 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.800628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.809862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.810753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.811203 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.811539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.812297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.814610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.837735 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1336/2672] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:34.841964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.854172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeec30-7ab0-49b3-a744-a83cfbccc876 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.859270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.860334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.861315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.861315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.862078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.864857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.876277 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1337/2673] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:34.880473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.891544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc66d-bfd7-491f-85a6-85b5a261d542 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.901726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.902353 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.902638 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.902943 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.904165 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.907587 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fbbc2-53d6-4b4a-801a-4531c90bbcdb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.919795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1337/2674] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:34.924411 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:34.935519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7e28-9397-4da6-8cfb-575dde55b37b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:34.940415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:34.941077 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.941354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.941653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] PATH_INFO: `/v3/projects/54adc9bca9264be787f77f92017fc6b9/users/6b804afa7554428982697cd6ee7843db/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:34.954885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:34.960681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54adc9bca9264be787f77f92017fc6b9, user_id=6b804afa7554428982697cd6ee7843db, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:34.963952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:34.980926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1338/2675] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:34 2022] PUT /identity/v3/projects/54adc9bca9264be787f77f92017fc6b9/users/6b804afa7554428982697cd6ee7843db/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:34.990875 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744660c-9508-43a6-ba53-32085535b886 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:34.991163 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744660c-9508-43a6-ba53-32085535b886 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:34.991442 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744660c-9508-43a6-ba53-32085535b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.021349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7744660c-9508-43a6-ba53-32085535b886 None None] MFA Rules not processed for user `6b804afa7554428982697cd6ee7843db`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:35.022580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7744660c-9508-43a6-ba53-32085535b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:35.090392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1338/2676] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:35.095652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.157141 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8479e-c6e0-4346-b17f-3c7a0b28fcd3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.161736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.162368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.162644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.162921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.163602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.165537 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.192131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1339/2677] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:35.196208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744660c-9508-43a6-ba53-32085535b886 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.208347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744660c-9508-43a6-ba53-32085535b886 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.267626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.268278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.268565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.268836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.269505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.271418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.291769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1339/2678] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:35.295702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.305933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599785-94a9-497a-a678-8c3eecce1d2c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.310561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.311163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.311448 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.312261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.312984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.314608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.325114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1340/2679] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:35.329914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.340099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d870-36c2-48cf-b413-c60da7046b75 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.344775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.345433 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.345727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.345993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] PATH_INFO: `/v3/projects/24dafb468baa4149bb0ee7027c941bcd/users/3c11b88ef08d4935a9e53433ee02b26d/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.360409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dafb468baa4149bb0ee7027c941bcd, user_id=3c11b88ef08d4935a9e53433ee02b26d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.363092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.377108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1340/2680] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:35 2022] PUT /identity/v3/projects/24dafb468baa4149bb0ee7027c941bcd/users/3c11b88ef08d4935a9e53433ee02b26d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:35.381004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.391533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b02a-67fc-47c6-80b1-4c89af36e34f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.451288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.451937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.452219 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.453086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.453774 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.455488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c60f6-2e95-46a2-aa05-b5778083a0e1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.467930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1341/2681] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:35.471516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.482832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6f490-fb25-4fc6-9afe-e50a2a273820 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.488157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.488845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.489130 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.489406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] PATH_INFO: `/v3/projects/24dafb468baa4149bb0ee7027c941bcd/users/3c11b88ef08d4935a9e53433ee02b26d/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.491738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dafb468baa4149bb0ee7027c941bcd, user_id=3c11b88ef08d4935a9e53433ee02b26d, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.494848 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.506030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1341/2682] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:35 2022] PUT /identity/v3/projects/24dafb468baa4149bb0ee7027c941bcd/users/3c11b88ef08d4935a9e53433ee02b26d/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:35.516843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.517142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.517427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.545838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] MFA Rules not processed for user `3c11b88ef08d4935a9e53433ee02b26d`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:35.547547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:35.595922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.619479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1342/2683] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:35.635168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.636962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:35.657712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:35.701627 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2cbb-225a-43aa-9996-0b4d73ad570b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.705388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.706047 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.706308 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.706583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.716350 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.717908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.728343 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1342/2684] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:35.814887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:35.824648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd906-3688-4b5a-86e5-0012adc56a99 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:35.829053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:35.830011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:35.830444 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:35.830878 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:35.891408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:35.892914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342e4d-6dfd-40fe-b293-04f227c0f136 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:35.902006 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1343/2685] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:40.949984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.023776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc1994-e40c-4fd8-9116-772d29453f33 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.029816 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.031034 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.031274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.031555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] PATH_INFO: `/v3/users/6b804afa7554428982697cd6ee7843db` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.032809 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b804afa7554428982697cd6ee7843db)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.034725 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.096059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b804afa7554428982697cd6ee7843db'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.097882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b804afa7554428982697cd6ee7843db'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.107529 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b804afa7554428982697cd6ee7843db'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.126739 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b804afa7554428982697cd6ee7843db'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.143383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b804afa7554428982697cd6ee7843db'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.149967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1343/2686] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:40 2022] DELETE /identity/v3/users/6b804afa7554428982697cd6ee7843db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:41.154617 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.155631 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.155856 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.176904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:41.178242 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:41.250330 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1344/2687] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:41.262586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.264037 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:41.314694 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:41.330505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da012b4b-2b98-42db-b9f5-7972a71e2902 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.334174 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.334855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.335145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.335448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.345329 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.346782 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.357171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1344/2688] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:41.647406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.649331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:41.664248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315534c-048a-45bd-a50b-1d1f956833ef None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.670095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.670910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.671263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.671577 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] PATH_INFO: `/v3/projects/54adc9bca9264be787f77f92017fc6b9` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.672987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54adc9bca9264be787f77f92017fc6b9)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.675056 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.732725 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54adc9bca9264be787f77f92017fc6b9', 'request_id': 'req-4ac3294b-1a22-4633-86ab-f5e88f7e210d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.741476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54adc9bca9264be787f77f92017fc6b9', 'request_id': 'req-4ac3294b-1a22-4633-86ab-f5e88f7e210d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.747518 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54adc9bca9264be787f77f92017fc6b9', 'request_id': 'req-4ac3294b-1a22-4633-86ab-f5e88f7e210d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.759602 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] The token cache is being invalidate because project 54adc9bca9264be787f77f92017fc6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:41.759920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.760557 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.762065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1345/2689] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:41 2022] DELETE /identity/v3/projects/54adc9bca9264be787f77f92017fc6b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:41.766228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:41.776170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef4b9-79b6-4f83-898a-12b79c5f753d service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:41.833818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:41.834617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:41.834896 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:41.835173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] PATH_INFO: `/v3/users/3c11b88ef08d4935a9e53433ee02b26d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:41.836423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c11b88ef08d4935a9e53433ee02b26d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:41.838479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:41.890226 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c11b88ef08d4935a9e53433ee02b26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.890937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c11b88ef08d4935a9e53433ee02b26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.898517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c11b88ef08d4935a9e53433ee02b26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.906440 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c11b88ef08d4935a9e53433ee02b26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.918536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-328cd7a1-c204-418e-a6b9-8eac57f7d282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c11b88ef08d4935a9e53433ee02b26d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:41.925025 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1345/2690] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:41 2022] DELETE /identity/v3/users/3c11b88ef08d4935a9e53433ee02b26d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:42.206062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.207857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:42.224660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3294b-1a22-4633-86ab-f5e88f7e210d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.229797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:42.292724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.293291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.293582 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.293873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] PATH_INFO: `/v3/projects/24dafb468baa4149bb0ee7027c941bcd` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.295240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dafb468baa4149bb0ee7027c941bcd)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.297335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.348406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dafb468baa4149bb0ee7027c941bcd', 'request_id': 'req-591e17e8-24ba-4d28-907f-11b43a650ada'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:42.356075 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dafb468baa4149bb0ee7027c941bcd', 'request_id': 'req-591e17e8-24ba-4d28-907f-11b43a650ada'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:42.362488 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dafb468baa4149bb0ee7027c941bcd', 'request_id': 'req-591e17e8-24ba-4d28-907f-11b43a650ada'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:42.374313 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] The token cache is being invalidate because project 24dafb468baa4149bb0ee7027c941bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:42.374648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:42.375252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-591e17e8-24ba-4d28-907f-11b43a650ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:42.377030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1346/2691] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:42 2022] DELETE /identity/v3/projects/24dafb468baa4149bb0ee7027c941bcd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:42.381898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.382392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.382751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.407532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:42.407532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:42.482635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1346/2692] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:42.490503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.490881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.491211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.512084 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:42.513298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:42.521689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1347/2693] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:42.526220 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.532104 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:42.538571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff8ce1-c3b1-4735-8074-abf01229e409 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.545050 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.545630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.545924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.546202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.546905 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:42.547214 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.548881 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.564553 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1347/2694] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:42.565734 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.575490 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c69a3d-84ed-4457-ac30-925441596bc4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.580703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.581315 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.581597 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.581872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.582547 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.584495 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.614054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1348/2695] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:42.618304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.629162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23974a0-2f6e-4080-a42a-ddf56f7c09fc admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.692091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.692763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.693088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.693325 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.694044 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.696006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.716771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1348/2696] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:42.721135 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.732004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde714d-fe57-43cd-b34b-4b75e34e1c29 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.736919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.737509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.737800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.738072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.738769 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.740451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.750958 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1349/2697] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:42.755777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.767277 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1cd0-4d77-404c-a4ea-d3ecfcdff51b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.772867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.773492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.773777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.774054 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.774762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.776431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784935a-22a1-42f1-a904-194591c3047d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.787156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1349/2698] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:42.791426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.801729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53f1df-732d-45c5-b95b-b2b896ae1ebf admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:42.806290 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:42.806944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.807230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.807511 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] PATH_INFO: `/v3/projects/c4bb58a2b5374400b3fd347c13e6fde5/users/41bb35f4a9114946970c89153d8fc159/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.823481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4bb58a2b5374400b3fd347c13e6fde5, user_id=41bb35f4a9114946970c89153d8fc159, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:42.826288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:42.840464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1350/2699] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:42 2022] PUT /identity/v3/projects/c4bb58a2b5374400b3fd347c13e6fde5/users/41bb35f4a9114946970c89153d8fc159/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:42.850693 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:42.850984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:42.851266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:42.879765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] MFA Rules not processed for user `41bb35f4a9114946970c89153d8fc159`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:42.880985 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:42.943622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1350/2700] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:42.948176 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:42.988323 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:43.017341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2662-c377-46f1-a0cd-1d89819283b8 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.021914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.022530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.022815 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.023092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.023772 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.025698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.052520 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1351/2701] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:42 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:43.056539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.067780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01512-c50c-4931-84de-94fc70c16851 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.119055 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:43.126805 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.127775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.128269 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.128546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.129219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.131137 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.151250 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1351/2702] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:43 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:43.155525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.165784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad583ef-a06f-4a74-ae54-af610f429e33 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.171095 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.171715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.172058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.172328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.173098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.174803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.185413 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1352/2703] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:43.189917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.199648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19d6e1-5195-4554-8e3a-9f5e74839016 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.204231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.204876 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.205159 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.205436 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] PATH_INFO: `/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2/users/ff635559cc9f42d0840a0f0f0d559b68/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.219765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3be1bbb2f1420ba224e2f76e5d7df2, user_id=ff635559cc9f42d0840a0f0f0d559b68, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.222392 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.236611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1352/2704] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:43 2022] PUT /identity/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2/users/ff635559cc9f42d0840a0f0f0d559b68/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:43.240527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.250944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52936-ca29-4acb-9d5b-808ff514a68d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.307299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.307887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.308169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.308442 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.309127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.310720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07035f2-ae93-425b-9565-6c8fa49bee44 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.320990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1353/2705] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:43.325109 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.335534 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d5ef3-a126-400b-a9aa-75da3eb71c8e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.340157 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.340811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.341093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.341370 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] PATH_INFO: `/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2/users/ff635559cc9f42d0840a0f0f0d559b68/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.343963 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3be1bbb2f1420ba224e2f76e5d7df2, user_id=ff635559cc9f42d0840a0f0f0d559b68, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.346625 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.356892 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1353/2706] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:43 2022] PUT /identity/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2/users/ff635559cc9f42d0840a0f0f0d559b68/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:43.368062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.368356 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.368638 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.397278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] MFA Rules not processed for user `ff635559cc9f42d0840a0f0f0d559b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:43.398534 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:43.465703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1354/2707] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:43.476568 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:43.478323 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:43.535868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16868557-76cf-43e3-a046-8f81dd8b3745 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:43.539460 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:43.540099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:43.540377 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:43.540661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:43.549766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:43.551208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfc0a7-11ea-4be3-9b50-b967a473f4d9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:43.561139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1354/2708] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:44.030573 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.063944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.104008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477923-117e-4fb5-bb25-37a91f08448f None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.109642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.110174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.110633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.110931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] PATH_INFO: `/v3/users/41bb35f4a9114946970c89153d8fc159` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.112850 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41bb35f4a9114946970c89153d8fc159)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.114128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.162777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41bb35f4a9114946970c89153d8fc159'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.163479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41bb35f4a9114946970c89153d8fc159'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.170365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41bb35f4a9114946970c89153d8fc159'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.178354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41bb35f4a9114946970c89153d8fc159'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.179040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41bb35f4a9114946970c89153d8fc159'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.197230 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1355/2709] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:44 2022] DELETE /identity/v3/users/41bb35f4a9114946970c89153d8fc159 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:44.201710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.202059 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.202400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.222170 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:44.223368 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:44.287115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1355/2710] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:44.297483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.299046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:44.360447 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab67e3-1654-4a80-85b1-be7635df9b93 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.364136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.364755 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.365040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.365316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.374740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.376228 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.386003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1356/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:44.654662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.656663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:44.668683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbea04-6f2e-4651-bb9a-54873f785e9d None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.673375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.674085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.674363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.674924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] PATH_INFO: `/v3/projects/c4bb58a2b5374400b3fd347c13e6fde5` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.676166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4bb58a2b5374400b3fd347c13e6fde5)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.678227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.724120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.725482 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4bb58a2b5374400b3fd347c13e6fde5', 'request_id': 'req-d17af3df-167f-481e-bbe7-579dabcb06d2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.734224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4bb58a2b5374400b3fd347c13e6fde5', 'request_id': 'req-d17af3df-167f-481e-bbe7-579dabcb06d2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.740229 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4bb58a2b5374400b3fd347c13e6fde5', 'request_id': 'req-d17af3df-167f-481e-bbe7-579dabcb06d2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.751231 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] The token cache is being invalidate because project c4bb58a2b5374400b3fd347c13e6fde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:44.751516 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.752167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.753669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1356/2712] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:44 2022] DELETE /identity/v3/projects/c4bb58a2b5374400b3fd347c13e6fde5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:44.757533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.767668 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db1915-ca5f-4116-8b46-dabad5ab7a6e service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.815003 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:44.828240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.828947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.829478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.829819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] PATH_INFO: `/v3/users/ff635559cc9f42d0840a0f0f0d559b68` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.831124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff635559cc9f42d0840a0f0f0d559b68)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.833027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.844573 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:44.847547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:44.861320 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17af3df-167f-481e-bbe7-579dabcb06d2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:44.866333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:44.867009 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.867288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.867866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] PATH_INFO: `/v3/users/1ff85ad5c241483487fd3a76d6e188b7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.868929 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff85ad5c241483487fd3a76d6e188b7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:44.870967 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:44.892278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff635559cc9f42d0840a0f0f0d559b68'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.892930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff635559cc9f42d0840a0f0f0d559b68'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.900812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff635559cc9f42d0840a0f0f0d559b68'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.908984 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff635559cc9f42d0840a0f0f0d559b68'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.909740 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3043999f-bf62-4f50-a5ae-0c4b19b7e356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff635559cc9f42d0840a0f0f0d559b68'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.919832 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff85ad5c241483487fd3a76d6e188b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.920524 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff85ad5c241483487fd3a76d6e188b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.927662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1357/2713] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:44 2022] DELETE /identity/v3/users/ff635559cc9f42d0840a0f0f0d559b68 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:44.931238 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff85ad5c241483487fd3a76d6e188b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.940691 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff85ad5c241483487fd3a76d6e188b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.953237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff85ad5c241483487fd3a76d6e188b7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:44.959347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1357/2714] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:44 2022] DELETE /identity/v3/users/1ff85ad5c241483487fd3a76d6e188b7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:44.963733 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5683-f757-4dff-9168-741329132609 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:44.964128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5683-f757-4dff-9168-741329132609 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:44.964503 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b5683-f757-4dff-9168-741329132609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:44.984126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f64b5683-f757-4dff-9168-741329132609 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:44.986341 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f64b5683-f757-4dff-9168-741329132609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.051060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1358/2715] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:45.060763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.062736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.125222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe97d5-f8d6-42f3-932f-ddfdc03af502 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.128920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.129583 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.129867 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.130145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.141629 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.143081 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6f4db-ac0e-4b3a-94e1-5f4388a4e9fe service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.155837 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1358/2716] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:45.289585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5683-f757-4dff-9168-741329132609 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.291371 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f64b5683-f757-4dff-9168-741329132609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.306804 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b5683-f757-4dff-9168-741329132609 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.319085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.319978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.320190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.320525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] PATH_INFO: `/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.322140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3be1bbb2f1420ba224e2f76e5d7df2)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.324333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.392421 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3be1bbb2f1420ba224e2f76e5d7df2', 'request_id': 'req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.405784 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3be1bbb2f1420ba224e2f76e5d7df2', 'request_id': 'req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.416887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3be1bbb2f1420ba224e2f76e5d7df2', 'request_id': 'req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.418094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.432333 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] The token cache is being invalidate because project db3be1bbb2f1420ba224e2f76e5d7df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:45.432718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.433551 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c9c6e37e-605e-4a7c-a7c6-7a3269fe72fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.435603 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1359/2717] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:45 2022] DELETE /identity/v3/projects/db3be1bbb2f1420ba224e2f76e5d7df2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:45.440813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.441182 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.441672 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.465727 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:45.468742 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.520969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.538773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1359/2718] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:45.547065 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.547217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.547531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.550309 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.551972 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.566746 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ac3d4-38b1-41f5-a8ef-373a7f8031d9 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.572224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.573001 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.573415 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.573559 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:45.573827 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] PATH_INFO: `/v3/projects/2a205105b55d4b81aedbd89ae192467f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.574658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.575563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a205105b55d4b81aedbd89ae192467f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.579649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.590811 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1360/2719] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:45.595432 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.604748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559cc7-0de7-45c5-a85c-2c4b9b8f7482 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.609583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.610199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.610479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.610751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.611446 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:45.611782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.613474 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.626227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1361/2720] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:45.630532 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.631772 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a205105b55d4b81aedbd89ae192467f', 'request_id': 'req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.639915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a205105b55d4b81aedbd89ae192467f', 'request_id': 'req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.641906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950d28-6a9e-400a-a4fa-a950476c1323 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.645606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a205105b55d4b81aedbd89ae192467f', 'request_id': 'req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.657345 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] The token cache is being invalidate because project 2a205105b55d4b81aedbd89ae192467f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:45.658012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.658347 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9d3e23c7-51b6-4ed4-9e6c-806280d2647f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:45.659916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1360/2721] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:45 2022] DELETE /identity/v3/projects/2a205105b55d4b81aedbd89ae192467f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:45.664592 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939bd6-2f9d-4a92-b616-2d290c7bda72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.664879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939bd6-2f9d-4a92-b616-2d290c7bda72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.665156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9939bd6-2f9d-4a92-b616-2d290c7bda72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.684236 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-d9939bd6-2f9d-4a92-b616-2d290c7bda72 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:45.685551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d9939bd6-2f9d-4a92-b616-2d290c7bda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.702562 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.703212 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.703498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.703799 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.704468 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.706382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.747785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1361/2722] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:45.756371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.756662 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.756945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.778535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:45.779866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.788087 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1362/2723] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:45.792385 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.802546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede400cc-4965-41cb-a8a1-cb96ec6e7677 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.807671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.808372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.808655 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.808927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.809804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:45.809977 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.812227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.825344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1363/2724] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:45.830283 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.840474 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13354a2d-e736-42ae-b26e-6063dacf3274 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.845365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.845919 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.846201 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.846481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.847158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.849168 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.860451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1362/2725] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:45.864515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.866071 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:45.879787 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1364/2726] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:45.881509 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.917912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:45.933684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940af16-f20d-46bc-9c47-adc1b779151e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.947523 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c905e-afa3-466c-b317-50d75a98a08f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.953121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.953736 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.954014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.954287 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.954947 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.956893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.978748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1365/2727] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:45.982711 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:45.992738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f997e-8e43-44e5-9d97-b67dda90a85a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:45.994301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.994922 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.995204 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.995477 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:45.996175 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:45.997640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:45.998102 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:45.998232 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:45.998514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:45.999354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.000205 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.001789 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.009581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.012863 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1366/2728] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:46.017336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.024692 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1363/2729] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:45 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:46.025675 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.028245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c878168-e4cf-41c4-840e-d70cd4760dcb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.032945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.033551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.033836 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.034114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.034859 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.035552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0ab7-4448-4298-9496-b8d0ff472f3c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.036490 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.040145 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.040742 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.041020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.041291 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.041977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.043545 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.047550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1367/2730] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:46.051475 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.058451 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1364/2731] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:46.061102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d7925-7889-48aa-81db-6625ad72ce1b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.062793 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.066351 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.066999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.067278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.067549 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] PATH_INFO: `/v3/projects/69d6bcdc73de4a058940c57824c1832e/users/63ae321a9c5e4bcd860d112dc9674e02/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.073377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66023be9-4626-42cc-95ff-72f781be49dd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.078838 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.079470 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.079770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.080087 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.080778 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.082372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.083281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d6bcdc73de4a058940c57824c1832e, user_id=63ae321a9c5e4bcd860d112dc9674e02, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.085994 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e9b72-2ce7-4a70-98d4-cf887d12c914 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.093869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1365/2732] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:46.098118 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.100357 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1368/2733] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:46 2022] PUT /identity/v3/projects/69d6bcdc73de4a058940c57824c1832e/users/63ae321a9c5e4bcd860d112dc9674e02/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:46.104980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.105266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.105541 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.108697 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85808ae7-ffb5-4a50-b7d2-f2d8475d0f69 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.125084 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:46.126312 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:46.168895 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.169563 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.169844 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.170123 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] PATH_INFO: `/v3/projects/5b081fe31edf4e6fa98c3c2a4178b6f5/users/c78bd6671b3d431eb1f4c03f3c9294f1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.185206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b081fe31edf4e6fa98c3c2a4178b6f5, user_id=c78bd6671b3d431eb1f4c03f3c9294f1, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.187531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1369/2734] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:46.188527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fd35c-3724-4b97-9c92-e3cee4114373 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.196715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.198428 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:46.204124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1366/2735] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:46 2022] PUT /identity/v3/projects/5b081fe31edf4e6fa98c3c2a4178b6f5/users/c78bd6671b3d431eb1f4c03f3c9294f1/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:46.215136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.215431 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.215713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.245720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] MFA Rules not processed for user `c78bd6671b3d431eb1f4c03f3c9294f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:46.246937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:46.262488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913d7d-259c-4779-b363-40a6f9f4bddf None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.292408 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.313957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.314320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1367/2736] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:46.314915 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.315196 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.315472 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.319132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.367160 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:46.378845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.380374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.383896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d429-1d95-49f6-8abc-0917b51f1569 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.388689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.389329 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.389611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.389885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.390136 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1370/2737] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:46.390691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.392854 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.432627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1368/2738] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:46.433766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.444949 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f28-b1ee-49ab-afac-139d4b67b900 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.516079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.517132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.517132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.517458 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.518677 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.521710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.544857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1371/2739] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:46.551211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.563265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170fea-101b-4211-bc49-ed3a3ba169a1 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.568168 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.568842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.569122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.569521 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.570930 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.572941 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.584987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1369/2740] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:46.589359 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.604219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61db1-34b9-4f85-8134-b7bccb452a41 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.609722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.610403 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.610682 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.611085 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] PATH_INFO: `/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9/users/9294f5e35ee44b2ca4d290382b203d0b/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.628288 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f587186dc5f94a7caa99fdf3ea960cc9, user_id=9294f5e35ee44b2ca4d290382b203d0b, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.630898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.649052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1372/2741] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:46 2022] PUT /identity/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9/users/9294f5e35ee44b2ca4d290382b203d0b/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:46.653050 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.665049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be167-8b51-45b5-bf22-1d1342cfb5a6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.751425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.752144 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.752429 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.752756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.753828 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.755248 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a229-f3f5-4099-8d2e-64b4e192eab2 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.781691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1370/2742] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:46.785395 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.800714 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f79fcd-8aba-4603-ab83-aef1cd14b59a admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:46.809893 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:46.812705 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.813648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.814120 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] PATH_INFO: `/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9/users/9294f5e35ee44b2ca4d290382b203d0b/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.817517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f587186dc5f94a7caa99fdf3ea960cc9, user_id=9294f5e35ee44b2ca4d290382b203d0b, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:46.822716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:46.845505 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1373/2743] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:46 2022] PUT /identity/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9/users/9294f5e35ee44b2ca4d290382b203d0b/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:46.855770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:46.856058 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:46.856324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:46.887409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] MFA Rules not processed for user `9294f5e35ee44b2ca4d290382b203d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:46.888873 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:46.980652 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1371/2744] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:46.989708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:46.991648 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:47.046833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.070175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286584-9646-460f-bc1c-016ba98dc207 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.074548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.075280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.076278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.076278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.097014 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.098491 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.127097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1374/2745] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:47.201195 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.211822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f12a5-7212-465b-bc1a-21542e9962ee None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.216781 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.218001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.218284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.218553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.278430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:47.302233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.303693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bd183-0588-45f3-9abb-4b6a29cdc231 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.315395 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1372/2746] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:47.625794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.696586 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84132175-1a56-4aef-bcaa-7fdb3fda5cc1 service cinder] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.702811 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.703457 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.703765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.704144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] PATH_INFO: `/v3/users/c78bd6671b3d431eb1f4c03f3c9294f1` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.706821 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78bd6671b3d431eb1f4c03f3c9294f1)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.707321 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:47.761033 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78bd6671b3d431eb1f4c03f3c9294f1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:47.762326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78bd6671b3d431eb1f4c03f3c9294f1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:47.776795 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78bd6671b3d431eb1f4c03f3c9294f1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:47.787785 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78bd6671b3d431eb1f4c03f3c9294f1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:47.817367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78bd6671b3d431eb1f4c03f3c9294f1'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:47.824122 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1375/2747] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:47 2022] DELETE /identity/v3/users/c78bd6671b3d431eb1f4c03f3c9294f1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:47.828443 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.828732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.829010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.854062 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:47.855340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:47.930862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.931621 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:47.933441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1373/2748] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:47.943887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:47.945426 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:47.963451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765516-22ce-44f1-af46-b91ad83876e2 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:47.973010 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:47.981079 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:47.981580 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:47.981903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] PATH_INFO: `/v3/users/ae798deb341e43d89167c0e83d8ca8c7` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:47.987556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae798deb341e43d89167c0e83d8ca8c7)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:47.995585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.074871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf066e70-e670-485d-905b-58e647b90ab2 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.080965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.081906 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.082509 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.082841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.087600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae798deb341e43d89167c0e83d8ca8c7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.088708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae798deb341e43d89167c0e83d8ca8c7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.096653 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:48.098317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.101208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.103193 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae798deb341e43d89167c0e83d8ca8c7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.116704 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae798deb341e43d89167c0e83d8ca8c7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.117124 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1374/2749] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:48.141525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae798deb341e43d89167c0e83d8ca8c7'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.156570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1376/2750] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:47 2022] DELETE /identity/v3/users/ae798deb341e43d89167c0e83d8ca8c7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:48.446810 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:48.459196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36a83b-98ea-4d81-8716-935922b65461 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.535698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.536732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.537011 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.537286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] PATH_INFO: `/v3/projects/53465b9273364951badfe403d038901c` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.538703 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53465b9273364951badfe403d038901c)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.540722 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.578133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:48.597425 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53465b9273364951badfe403d038901c', 'request_id': 'req-12f85bf3-bda2-4f9e-8370-7856db26bb03'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.606462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53465b9273364951badfe403d038901c', 'request_id': 'req-12f85bf3-bda2-4f9e-8370-7856db26bb03'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.613502 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53465b9273364951badfe403d038901c', 'request_id': 'req-12f85bf3-bda2-4f9e-8370-7856db26bb03'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.626770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] The token cache is being invalidate because project 53465b9273364951badfe403d038901c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:48.627069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.627782 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.629525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1375/2751] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:48 2022] DELETE /identity/v3/projects/53465b9273364951badfe403d038901c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:48.633545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:48.635030 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:48.649676 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099248cc-eb0d-4fac-8131-f2841abc0e0f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:48.725719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:48.726519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:48.726904 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:48.727285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] PATH_INFO: `/v3/users/e8c0944afb294db4a0e95524064a95c3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:48.728661 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c0944afb294db4a0e95524064a95c3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:48.730715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:48.789925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c0944afb294db4a0e95524064a95c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.791431 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c0944afb294db4a0e95524064a95c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.801945 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c0944afb294db4a0e95524064a95c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.811409 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c0944afb294db4a0e95524064a95c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.826493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c0944afb294db4a0e95524064a95c3'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:48.832728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1377/2752] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:48 2022] DELETE /identity/v3/users/e8c0944afb294db4a0e95524064a95c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:48.931598 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:48.933127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:48.948381 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f85bf3-bda2-4f9e-8370-7856db26bb03 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.036565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.037715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.038163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.038599 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] PATH_INFO: `/v3/projects/5b081fe31edf4e6fa98c3c2a4178b6f5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.040100 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b081fe31edf4e6fa98c3c2a4178b6f5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.043107 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.087143 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.088669 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.115649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4ea66-85ff-4bb6-a951-d59a7d9a1d8c admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.122122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b081fe31edf4e6fa98c3c2a4178b6f5', 'request_id': 'req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.132977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b081fe31edf4e6fa98c3c2a4178b6f5', 'request_id': 'req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.143550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b081fe31edf4e6fa98c3c2a4178b6f5', 'request_id': 'req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.160475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] The token cache is being invalidate because project 5b081fe31edf4e6fa98c3c2a4178b6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:49.160852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.162299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.166803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1376/2753] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:48 2022] DELETE /identity/v3/projects/5b081fe31edf4e6fa98c3c2a4178b6f5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:49.169324 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.173583 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.175406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:49.215584 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.216965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.217291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.217574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] PATH_INFO: `/v3/projects/9bb0eac868c94c17b21a7c053201f759` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.218993 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb0eac868c94c17b21a7c053201f759)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.221069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.251136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:49.298234 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee334-6922-43d9-ba2c-bca6c69f37ed admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.305032 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb0eac868c94c17b21a7c053201f759', 'request_id': 'req-56e54414-5d3d-4f26-be49-84f1447016f2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.321998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb0eac868c94c17b21a7c053201f759', 'request_id': 'req-56e54414-5d3d-4f26-be49-84f1447016f2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.346812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb0eac868c94c17b21a7c053201f759', 'request_id': 'req-56e54414-5d3d-4f26-be49-84f1447016f2'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.391133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] The token cache is being invalidate because project 9bb0eac868c94c17b21a7c053201f759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:49.391784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.392685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-56e54414-5d3d-4f26-be49-84f1447016f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.394773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1378/2754] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:49 2022] DELETE /identity/v3/projects/9bb0eac868c94c17b21a7c053201f759 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:49.410252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f944a-b806-44d3-b81a-5db6b0ecf552 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.410818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f944a-b806-44d3-b81a-5db6b0ecf552 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.411543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f944a-b806-44d3-b81a-5db6b0ecf552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.456132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.456132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.456132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.456132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] PATH_INFO: `/v3/users/9294f5e35ee44b2ca4d290382b203d0b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.456947 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9294f5e35ee44b2ca4d290382b203d0b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.458876 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.470938 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-cd1f944a-b806-44d3-b81a-5db6b0ecf552 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:49.472243 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cd1f944a-b806-44d3-b81a-5db6b0ecf552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.485035 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1379/2755] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:49.494274 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.494559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.494838 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.523660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:49.525140 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.544479 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1380/2756] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:49.550508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.563170 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9294f5e35ee44b2ca4d290382b203d0b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.568339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5b55-df26-4fc2-a212-819fd7f7db42 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.575984 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.577406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.577912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.578337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.579914 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:49.580384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.582517 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.586251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9294f5e35ee44b2ca4d290382b203d0b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.605290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1381/2757] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:49.605453 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9294f5e35ee44b2ca4d290382b203d0b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.609303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.613942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:49.618262 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9294f5e35ee44b2ca4d290382b203d0b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.619550 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9294f5e35ee44b2ca4d290382b203d0b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:49.641897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aef76-d777-402c-a6ca-b62e1a09e5f4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.654950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.654950 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.655293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.655463 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.656173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.657409 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1377/2758] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:49 2022] DELETE /identity/v3/users/9294f5e35ee44b2ca4d290382b203d0b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:49.663956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.714102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1382/2759] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:49 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:49.717843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.846959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a362a4b-f9a7-443a-95e6-5d61c4595bf6 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.864656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:49.918385 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.919019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.919298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.919569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.920816 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.922749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.945528 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1378/2760] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:49 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:49.949681 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.960290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0024962-0cfe-47f4-b88d-84b11605c7d9 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:49.964751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:49.965367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:49.965645 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:49.965965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:49.966670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:49.968341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:49.979467 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1383/2761] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:49.984121 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:49.996688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca155f-cf65-47f8-966a-ff2c8de0225f admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.002059 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.002845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.003224 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.003644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.004469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.006165 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419f4ba-ff52-4997-ae7a-bb9eaae78395 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.017684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1379/2762] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:50.022124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.032960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112e73-5ea8-4c52-a84a-a443d6479a6f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.039062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.039550 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.039992 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.040546 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] PATH_INFO: `/v3/projects/4273da67e1164901921f700104ef8e60/users/9db08cbb38b346959f85af3bfa3a7bf6/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.056925 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4273da67e1164901921f700104ef8e60, user_id=9db08cbb38b346959f85af3bfa3a7bf6, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.059720 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.077017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1384/2763] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:50 2022] PUT /identity/v3/projects/4273da67e1164901921f700104ef8e60/users/9db08cbb38b346959f85af3bfa3a7bf6/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:50.088751 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.089043 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.089317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.119286 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] MFA Rules not processed for user `9db08cbb38b346959f85af3bfa3a7bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:50.120558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.197507 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.199384 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.215635 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1380/2764] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:50.224839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.226773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.287026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.293969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5ce7-a293-4c95-a187-608095986f35 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.300856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.302371 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.302650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.302969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] PATH_INFO: `/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.304665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f587186dc5f94a7caa99fdf3ea960cc9)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.307090 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.323338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bafd64-fc2d-45f5-8352-68ed84d96d41 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.329581 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.331020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.331020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.331020 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.345926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.347514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4ca19-a192-4e31-87a4-3a83f567d0bf service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.370795 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1381/2765] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:50.371173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f587186dc5f94a7caa99fdf3ea960cc9', 'request_id': 'req-1d2f6cc0-9147-4ecf-8498-37d4c965adda'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:50.382908 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f587186dc5f94a7caa99fdf3ea960cc9', 'request_id': 'req-1d2f6cc0-9147-4ecf-8498-37d4c965adda'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:50.392107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f587186dc5f94a7caa99fdf3ea960cc9', 'request_id': 'req-1d2f6cc0-9147-4ecf-8498-37d4c965adda'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:50.413847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] The token cache is being invalidate because project f587186dc5f94a7caa99fdf3ea960cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:50.414659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:50.415817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-1d2f6cc0-9147-4ecf-8498-37d4c965adda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:50.418897 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1385/2766] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:50 2022] DELETE /identity/v3/projects/f587186dc5f94a7caa99fdf3ea960cc9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:50.423779 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.423978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.424213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.474777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:50.477306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.513552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:50.581001 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1382/2767] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:50.589839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.590852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.591303 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.615450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:50.616997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:50.627128 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1386/2768] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:50.631527 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.642821 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9fea-126d-4ae9-8474-e7f0e9b6dbe1 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.649932 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.650933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.651281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.651658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.653340 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:50.653684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.655653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.672363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1383/2769] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:50.676920 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.701012 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b3a11-335d-43bf-8a52-4b0b8d3ffdd5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.712628 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.716000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.716444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.716955 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.717768 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.720670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.759623 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.769617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1387/2770] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/projects => generated 361 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:50.774846 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f0f31-3f09-484a-b06c-8914b564f69c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.905680 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.906952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.907350 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.907732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.909328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.913835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.944749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1384/2771] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:50 2022] POST /identity/v3/users => generated 281 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:50.949841 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:50.966528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507120d-be72-4bf6-9432-c6e0086a8d33 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:50.975923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:50.976942 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:50.977338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:50.977717 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:50.979319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:50.982936 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:50.997171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1388/2772] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:51.001643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.015257 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbfd1-5e45-432d-a715-f89f82657f47 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.020328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.020988 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.021281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.021567 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.022667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.024464 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c841-978c-40ed-92f1-4639bfafbcfe admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.052046 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1385/2773] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:51.052439 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.075400 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcef81-6152-4223-b5a8-f04c99eb54b6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.083766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.084581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.085222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.085222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] PATH_INFO: `/v3/projects/2217f6c0ce924a59a3c52aee06d6a572/users/53c954bf7ef24546bd0d37b7d0d2ef7b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.104818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2217f6c0ce924a59a3c52aee06d6a572, user_id=53c954bf7ef24546bd0d37b7d0d2ef7b, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.107521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.122898 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1389/2774] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:51 2022] PUT /identity/v3/projects/2217f6c0ce924a59a3c52aee06d6a572/users/53c954bf7ef24546bd0d37b7d0d2ef7b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:51.199773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.199773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.199773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.237113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] MFA Rules not processed for user `53c954bf7ef24546bd0d37b7d0d2ef7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:51.238328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:51.335710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1386/2775] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:51.380951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.383393 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:51.483932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89433b29-ff21-4ea7-ac02-53cfaf098f97 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.488139 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.488722 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.489006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.489285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.501187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.502686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270ade9-2081-43b6-b5c0-745e4f72b7a0 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.515113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1390/2776] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:51.532776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.569658 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.625743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a011fa-54ba-4d31-b488-f6dd82c89056 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:51.631041 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:51.631840 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.632210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.632558 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] PATH_INFO: `/v3/users/53c954bf7ef24546bd0d37b7d0d2ef7b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.633896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c954bf7ef24546bd0d37b7d0d2ef7b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:51.636023 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:51.697985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c954bf7ef24546bd0d37b7d0d2ef7b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:51.698660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c954bf7ef24546bd0d37b7d0d2ef7b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:51.708718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c954bf7ef24546bd0d37b7d0d2ef7b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:51.720174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c954bf7ef24546bd0d37b7d0d2ef7b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:51.721708 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c954bf7ef24546bd0d37b7d0d2ef7b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:51.749700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1387/2777] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:51 2022] DELETE /identity/v3/users/53c954bf7ef24546bd0d37b7d0d2ef7b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:51.751344 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672af9e-09f3-4c32-ab60-9dbb807d46c2 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:51.751660 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672af9e-09f3-4c32-ab60-9dbb807d46c2 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:51.753098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672af9e-09f3-4c32-ab60-9dbb807d46c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:51.800260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c672af9e-09f3-4c32-ab60-9dbb807d46c2 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:51.804133 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c672af9e-09f3-4c32-ab60-9dbb807d46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:51.843957 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:51.929581 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1391/2778] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:51.942993 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:51.945014 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.068977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932663c-8ad1-4110-a025-38ba0766859b admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.086914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.087450 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.087732 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.088091 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.110637 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.112155 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.128159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1388/2779] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:52.176729 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.177973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.178483 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.224045 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] MFA Rules not processed for user `63ae321a9c5e4bcd860d112dc9674e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:52.225560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.300023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1392/2780] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:52.304229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.305718 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.321289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02924-8cf4-44e9-b5ae-4b027584dfa6 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.330159 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.330785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.331061 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.331338 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.332076 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.333975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.365372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1389/2781] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:52.369747 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.388062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121c347-0cd9-4023-b086-71542f72d749 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.446978 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.447773 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.448115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.448399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.449114 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.452349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.462561 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.464614 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.478496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d44d-67bd-4803-b67d-08367b44f352 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.483973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.484670 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.484996 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.485434 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] PATH_INFO: `/v3/projects/2217f6c0ce924a59a3c52aee06d6a572` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.486758 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2217f6c0ce924a59a3c52aee06d6a572)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.488879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.489389 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1393/2782] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:52.493301 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.506437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439196f6-492d-4509-a7bc-7ec703629064 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.512115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.512751 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.513108 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.513521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.515021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.516738 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.522794 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.533334 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1394/2783] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:52.534508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.548251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e71e9-efcf-4600-9655-605a46207601 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.554727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2217f6c0ce924a59a3c52aee06d6a572', 'request_id': 'req-acc27a82-ef5a-478b-9cd7-077079f1821b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:52.566515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2217f6c0ce924a59a3c52aee06d6a572', 'request_id': 'req-acc27a82-ef5a-478b-9cd7-077079f1821b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:52.573180 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2217f6c0ce924a59a3c52aee06d6a572', 'request_id': 'req-acc27a82-ef5a-478b-9cd7-077079f1821b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:52.585780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.586729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] The token cache is being invalidate because project 2217f6c0ce924a59a3c52aee06d6a572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:52.587027 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:52.587724 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-acc27a82-ef5a-478b-9cd7-077079f1821b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:52.589359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1390/2784] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:52 2022] DELETE /identity/v3/projects/2217f6c0ce924a59a3c52aee06d6a572 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:52.594376 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0236-e7da-4448-8a8c-7446a24f34a9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.594660 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0236-e7da-4448-8a8c-7446a24f34a9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.594931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0236-e7da-4448-8a8c-7446a24f34a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.616460 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-092b0236-e7da-4448-8a8c-7446a24f34a9 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:52.617701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-092b0236-e7da-4448-8a8c-7446a24f34a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.619530 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.620273 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.620551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.620824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] PATH_INFO: `/v3/projects/f008bf83e92e4840a049651e19ff0b74/users/e8159a0947404bda8a3056e22718e211/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.627398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1391/2785] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:52.635094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.635386 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.635669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.641330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f008bf83e92e4840a049651e19ff0b74, user_id=e8159a0947404bda8a3056e22718e211, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.644354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.656138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:52.657370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.658026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1395/2786] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:52 2022] PUT /identity/v3/projects/f008bf83e92e4840a049651e19ff0b74/users/e8159a0947404bda8a3056e22718e211/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:52.661911 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.663597 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:52.727150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1392/2787] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:52.728730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.734444 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ec8cc-44fe-43e3-9193-6af4c780c839 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.738669 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586b27d-f0dd-4e87-8cba-1c000c08d69e None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.739631 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.740304 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.740589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.740860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.741559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.743208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.743618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.745138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.745695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.745695 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.746383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:52.746688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.748351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.754683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1396/2788] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:52.758650 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.764254 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1393/2789] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 21:05:52.768696 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.769817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df993199-2f24-44b8-932b-6ad4c883c690 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.775075 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.776219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.776219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.776450 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] PATH_INFO: `/v3/projects/f008bf83e92e4840a049651e19ff0b74/users/e8159a0947404bda8a3056e22718e211/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.778654 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f008bf83e92e4840a049651e19ff0b74, user_id=e8159a0947404bda8a3056e22718e211, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.780737 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49bee-1306-4405-a103-938639894ad0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.781438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.785716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.786480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.786764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.787037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.787702 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.789710 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:52.794195 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1397/2790] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:52 2022] PUT /identity/v3/projects/f008bf83e92e4840a049651e19ff0b74/users/e8159a0947404bda8a3056e22718e211/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:05:52.820133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1394/2791] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:52.824413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:52.898478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b8d8d-b035-44e7-b004-5a21d0ffa025 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:52.953282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:52.970862 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:52.971539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:52.971853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:52.972132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:52.972813 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:52.974762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.002503 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1398/2792] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:52 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:53.006869 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.030181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2e562-42b7-4113-8f56-302ba7ebd846 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.036589 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.037288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.037798 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.037933 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.038768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.040569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.053279 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1395/2793] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:53.057275 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.069671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080db4-9b95-4e9c-9a2b-fd73e320f0bd admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.076142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.076818 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.077103 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.077379 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.078093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.079715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32677009-b00e-4c82-9cd6-a41c5a8f78b5 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.092611 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1399/2794] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:53.096888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.128604 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb18330-c8c9-493e-8602-1d6fdfebe398 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.134136 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.134752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.135034 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.135312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] PATH_INFO: `/v3/projects/c2147adef2d64bd8928eee837fd28fe5/users/73ae11797ee7419ab1d25f7015fc9d9b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.154074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2147adef2d64bd8928eee837fd28fe5, user_id=73ae11797ee7419ab1d25f7015fc9d9b, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.157627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.174487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1396/2795] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:53 2022] PUT /identity/v3/projects/c2147adef2d64bd8928eee837fd28fe5/users/73ae11797ee7419ab1d25f7015fc9d9b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:53.184538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.185069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.185158 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.221687 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] MFA Rules not processed for user `73ae11797ee7419ab1d25f7015fc9d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:53.223200 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:53.322208 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1400/2796] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:53.326636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.424114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:53.479114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040cdb2-2dd0-4233-868f-89b27d72caea admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.492540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.493471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.494284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.495005 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.495480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.498156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.568517 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1397/2797] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:53 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:53.573565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.587445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618c1c2-d41a-490f-af32-8bfb350e989e None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.693983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.694675 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.695007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.695285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.696454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.698873 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.732551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1401/2798] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:53 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:53.736736 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.751920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c89c3-b0c3-46b5-ad78-6c70a863aa1d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.761812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.762501 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.762839 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.763114 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.764373 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.765981 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.781251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1398/2799] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:53.785671 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.805020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d4e9d-20a7-44ad-8065-cbc9c418ad02 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.812365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.812996 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.813278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.813555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.814266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.816282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641796-dd9f-4f58-8c10-d73ea4a2673c admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.837732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1402/2800] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:53.842707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:53.861321 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d65572-b3af-4cd0-a249-2cdb8b421d10 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:53.870317 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:53.872497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.873060 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.874085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] PATH_INFO: `/v3/projects/f83508dda4c4442dbf73fc8fefee00c7/users/8760832d9a2f4bb299e072937d8dc93d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.908222 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83508dda4c4442dbf73fc8fefee00c7, user_id=8760832d9a2f4bb299e072937d8dc93d, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:53.912210 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:53.934548 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1399/2801] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:53 2022] PUT /identity/v3/projects/f83508dda4c4442dbf73fc8fefee00c7/users/8760832d9a2f4bb299e072937d8dc93d/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:53.946189 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:53.946478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:53.946754 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:53.987779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] MFA Rules not processed for user `8760832d9a2f4bb299e072937d8dc93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:53.988327 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:54.021812 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.108732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1403/2802] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:54.113394 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.192461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7361e-1ce4-4df6-b3ee-4d9108464e27 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.198835 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.199655 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.199989 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.200715 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.201190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.203927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.240761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1400/2803] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:54 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:54.246755 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.265927 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5e792-2041-42b9-806c-89c2c0bdb88c None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.336525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.337177 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.337484 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.338251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.339173 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.341926 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.369776 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1404/2804] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:54 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:54.374326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.385946 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e83ab-5cce-4d85-8c89-865ff47106c9 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.392952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.394259 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.394610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.394945 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.396200 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.398132 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.414270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1401/2805] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:54.415465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.426356 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa4608-faaf-45d4-a5df-0ad6a09b6f65 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.431605 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.432097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.432375 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.433145 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] PATH_INFO: `/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f/users/b3ab78d0d4c144b9be2c2cfe681e4194/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.449589 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b04698a14ba4bd3a7a99cf1c866164f, user_id=b3ab78d0d4c144b9be2c2cfe681e4194, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.455574 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.477239 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1405/2806] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:54 2022] PUT /identity/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f/users/b3ab78d0d4c144b9be2c2cfe681e4194/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:54.478749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.491480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be878db-fe3f-4d25-b607-9a40d82455cd admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.559975 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.568748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.570354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.570808 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.571423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.572378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.574305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d92e1b-3099-4650-af36-9216c7f4b777 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.586306 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1402/2807] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:54.590906 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.606726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800666-895a-484c-9a8b-d637c016d379 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.613419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.614227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.615036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.615036 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] PATH_INFO: `/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f/users/b3ab78d0d4c144b9be2c2cfe681e4194/roles/c757366a629b447b93eff207471f3401` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.617522 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b04698a14ba4bd3a7a99cf1c866164f, user_id=b3ab78d0d4c144b9be2c2cfe681e4194, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.620397 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.637040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1406/2808] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:54 2022] PUT /identity/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f/users/b3ab78d0d4c144b9be2c2cfe681e4194/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:54.649284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.649284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.649284 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.678269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] MFA Rules not processed for user `b3ab78d0d4c144b9be2c2cfe681e4194`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:54.679549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:54.768104 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1403/2809] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:54.781098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:54.782878 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:54.848953 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f6306-ee27-4a4d-b986-c072683b0ba4 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:54.853420 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:54.854175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:54.854565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:54.854973 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:54.890853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:54.922997 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:54.924496 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970291f-d6ef-4b7e-97fb-42a0c40487d9 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:54.934670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1407/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:05:56.374051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.379270 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:56.470382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ab2e-1114-4a7f-b3cb-1b37271ed133 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.483038 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.483870 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.486345 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.486857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] PATH_INFO: `/v3/users/9db08cbb38b346959f85af3bfa3a7bf6` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.488937 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db08cbb38b346959f85af3bfa3a7bf6)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.495656 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.600362 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db08cbb38b346959f85af3bfa3a7bf6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:56.601800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db08cbb38b346959f85af3bfa3a7bf6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:56.617419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db08cbb38b346959f85af3bfa3a7bf6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:56.629307 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db08cbb38b346959f85af3bfa3a7bf6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:56.631111 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db08cbb38b346959f85af3bfa3a7bf6'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:56.648636 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:56.668054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1404/2811] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:05:56 2022] DELETE /identity/v3/users/9db08cbb38b346959f85af3bfa3a7bf6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:56.673227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.673709 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.674052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.727296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:56.728839 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:56.796498 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.798047 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:56.835582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1408/2812] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:05:56.854004 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:56.855990 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:56.952933 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4344ed-a66f-4159-8ae1-2db5b9e783e0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.953956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f480f-c13b-4042-8cae-26de3e898da4 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:56.958707 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.959354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.959635 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.959956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.966017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:56.967130 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:56.967588 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:56.968190 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:56.970225 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:56.974663 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:56.979954 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:56.995640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1409/2813] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:57.071649 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.075069 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bb62a-4bbc-4326-96f1-df5978c2c227 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.097273 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1405/2814] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:57.556764 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:57.558223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:57.577169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffb11-c877-4b37-b578-e59f91543efa service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:57.585900 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:57.586564 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.587335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.587335 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] PATH_INFO: `/v3/projects/4273da67e1164901921f700104ef8e60` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.588372 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4273da67e1164901921f700104ef8e60)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:57.590315 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:57.678702 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4273da67e1164901921f700104ef8e60', 'request_id': 'req-d05053a0-5ea7-4152-8069-cc2420be5973'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:57.689879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4273da67e1164901921f700104ef8e60', 'request_id': 'req-d05053a0-5ea7-4152-8069-cc2420be5973'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:57.700062 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4273da67e1164901921f700104ef8e60', 'request_id': 'req-d05053a0-5ea7-4152-8069-cc2420be5973'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:57.703338 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:57.720965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] The token cache is being invalidate because project 4273da67e1164901921f700104ef8e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:05:57.720965 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:57.722712 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-d05053a0-5ea7-4152-8069-cc2420be5973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:05:57.724630 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1410/2815] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:05:57 2022] DELETE /identity/v3/projects/4273da67e1164901921f700104ef8e60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:57.729944 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.730428 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.730515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:57.784098 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:57.785607 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:57.935606 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1406/2816] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:57.946790 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:57.947083 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:57.947365 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.000098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:58.001921 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.016784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1411/2817] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:58.020985 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.034187 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4804ab-db11-4501-908b-7d52bf585d59 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.039693 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.040629 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.041292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.041800 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.043000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:05:58.043500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.049610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.070093 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1407/2818] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:05:58.085149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.101358 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b9cfd-a4a6-4159-91fe-09c501f249d5 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.108179 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.109171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.109626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.110099 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.111300 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.112233 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.113951 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.114667 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.171039 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1412/2819] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:05:58 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 21:05:58.174913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.175471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.220393 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb7ca-41b4-48db-bcd3-e72c95190d61 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.273307 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98a1d-65cf-4f5c-a4a8-3b3b4ee84f0e admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.280884 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.282640 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.283096 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.283519 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.284845 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.288388 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.294221 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.295036 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.295595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.296002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.299249 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.331968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1413/2820] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:05:58 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:05:58.336565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.349753 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99a25f-152c-4c17-ae9b-9c1d2e39f4bf admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.371614 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.373775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.374132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.374478 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.375454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.377258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.425285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1414/2821] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:05:58.429609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.440441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.442008 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684de1e1-95cd-4607-8ebd-a9f7c5879828 service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.445098 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad378f9-31c0-4587-8024-47ee5b3ab174 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.450493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.456861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.456861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.456861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.456861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.456861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.457301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1408/2822] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:58.458029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.458476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.458907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.470763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1415/2823] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:05:58.472847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.484150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002b5f-009f-42af-9f86-d12703cf0480 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.491399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.492688 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.492969 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] MFA Rules not processed for user `e8159a0947404bda8a3056e22718e211`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:58.493407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.493932 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] PATH_INFO: `/v3/projects/648257407546465f9f7373d1611b6b28/users/0cfd826d02074f01917101d893775d92/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.494208 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.512525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648257407546465f9f7373d1611b6b28, user_id=0cfd826d02074f01917101d893775d92, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.516713 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52f44d-7dcf-4662-b4c8-4eaaee1b5604 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.533536 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1416/2824] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:05:58 2022] PUT /identity/v3/projects/648257407546465f9f7373d1611b6b28/users/0cfd826d02074f01917101d893775d92/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:05:58.540043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.540043 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.540455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.564002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:58.565235 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.593035 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1409/2825] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:58.605694 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.607414 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.644520 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1417/2826] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:58.654037 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.654826 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:58.656456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.672443 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:58.681775 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ce082-6887-4d7a-be65-805c9b5e2ca4 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.724894 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f73506-2dd7-4206-b34b-203e5b336136 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:58.729983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.730617 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.731225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.731508 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.739072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c49b3e48a8784ac5894e8399a737f3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:58.740122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.740122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.740463 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.742053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.742280 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:58.743429 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be6e9-f926-4667-9463-99ef62af3758 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.753600 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1418/2827] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:58.803217 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:58.804852 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:58.814449 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1410/2828] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:05:58.948367 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070cf73-3894-4e6c-a831-461a225e4af4 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:58.948659 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070cf73-3894-4e6c-a831-461a225e4af4 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:58.948941 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070cf73-3894-4e6c-a831-461a225e4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:58.968855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-8070cf73-3894-4e6c-a831-461a225e4af4 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:58.970016 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8070cf73-3894-4e6c-a831-461a225e4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:59.028647 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1419/2829] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:59.086615 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:59.088140 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:59.202849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365357-1697-4469-a7c0-9c7acc32e61c service glance] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:59.217481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:59.218384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:59.218858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:59.219299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:59.235382 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:59.238480 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:59.253209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1411/2830] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:05:59.507138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb978ea-b7bc-453e-ba92-1414db7c73c8 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:59.507435 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb978ea-b7bc-453e-ba92-1414db7c73c8 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:59.507728 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb978ea-b7bc-453e-ba92-1414db7c73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:59.543563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-3eb978ea-b7bc-453e-ba92-1414db7c73c8 None None] MFA Rules not processed for user `0cfd826d02074f01917101d893775d92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:05:59.549563 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-3eb978ea-b7bc-453e-ba92-1414db7c73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:05:59.641560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1420/2831] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:05:59.651677 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:05:59.709915 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=100 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:05:59.754264 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e9e2-c5ba-42c8-a271-a809f0dafe7f service swift] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:05:59.761078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:05:59.762334 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:05:59.762842 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:05:59.763726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:05:59.774764 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:05:59.777741 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:05:59.792214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1412/2832] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:06:01.511489 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:01.512487 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:01.512868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:01.535258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] MFA Rules not processed for user `0cfd826d02074f01917101d893775d92`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:01.536948 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:01.551286 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1421/2833] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:01.915926 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:01.917959 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:01.933971 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74627-e652-495c-8500-478e4813ea2f service cinder] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:01.949308 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:01.950397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:01.951365 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:01.951865 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:01.954163 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:01.977298 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:01.979122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d953ca-154e-48d0-bdd6-633400a9d714 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:01.991566 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1413/2834] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:06:02.901413 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:02.904020 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:02.919227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd523f-5c5c-4549-83c2-04307a5d8f90 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:02.926258 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:02.927296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:02.927726 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:02.928175 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] PATH_INFO: `/v3/users/73ae11797ee7419ab1d25f7015fc9d9b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:02.929576 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ae11797ee7419ab1d25f7015fc9d9b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:02.934148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:02.988731 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:03.013912 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ae11797ee7419ab1d25f7015fc9d9b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:03.014847 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ae11797ee7419ab1d25f7015fc9d9b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:03.026049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ae11797ee7419ab1d25f7015fc9d9b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:03.035006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ae11797ee7419ab1d25f7015fc9d9b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:03.053698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ae11797ee7419ab1d25f7015fc9d9b'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:03.062224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1422/2835] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:06:02 2022] DELETE /identity/v3/users/73ae11797ee7419ab1d25f7015fc9d9b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:03.067278 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.067822 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.067914 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.096864 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:03.098634 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:03.199896 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1414/2836] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:03.211290 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:03.213166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:03.289888 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac37d21-0375-4240-90e3-5a562a9f86e6 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:03.293525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:03.294987 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.295252 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.295528 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.307860 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:03.309172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:03.326493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1423/2837] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:06:03.947407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:03.949531 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:03.966956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643e66d-18b9-48c2-a855-f455b64d8181 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:03.973169 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:03.973955 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:03.974238 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:03.974522 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] PATH_INFO: `/v3/projects/c2147adef2d64bd8928eee837fd28fe5` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:03.975712 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2147adef2d64bd8928eee837fd28fe5)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:03.977910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:04.055514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2147adef2d64bd8928eee837fd28fe5', 'request_id': 'req-0e228f32-368f-402d-b7cc-45287684ce3d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.066202 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2147adef2d64bd8928eee837fd28fe5', 'request_id': 'req-0e228f32-368f-402d-b7cc-45287684ce3d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.073301 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2147adef2d64bd8928eee837fd28fe5', 'request_id': 'req-0e228f32-368f-402d-b7cc-45287684ce3d'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.093535 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] The token cache is being invalidate because project c2147adef2d64bd8928eee837fd28fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:06:04.093761 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.094397 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.097138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1415/2838] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:06:03 2022] DELETE /identity/v3/projects/c2147adef2d64bd8928eee837fd28fe5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:04.100708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:04.112538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d79e5-dbb4-491f-8ed6-fe44c04f77fe service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:04.182909 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:04.184148 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:04.184432 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:04.184771 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] PATH_INFO: `/v3/users/8760832d9a2f4bb299e072937d8dc93d` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:04.186606 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] RBAC: Authorizing `identity:delete_user(user_id=8760832d9a2f4bb299e072937d8dc93d)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:04.188770 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:04.264341 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8760832d9a2f4bb299e072937d8dc93d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.265018 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8760832d9a2f4bb299e072937d8dc93d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.278620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8760832d9a2f4bb299e072937d8dc93d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.284211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:04.289679 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8760832d9a2f4bb299e072937d8dc93d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.307437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8760832d9a2f4bb299e072937d8dc93d'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:04.316525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1424/2839] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:06:04 2022] DELETE /identity/v3/users/8760832d9a2f4bb299e072937d8dc93d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:06:04.969039 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:04.971473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:04.990564 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e228f32-368f-402d-b7cc-45287684ce3d admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:05.062478 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:05.085887 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:05.087485 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:05.087961 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:05.088384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] PATH_INFO: `/v3/projects/f83508dda4c4442dbf73fc8fefee00c7` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:05.090174 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83508dda4c4442dbf73fc8fefee00c7)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:05.096125 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:05.187206 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83508dda4c4442dbf73fc8fefee00c7', 'request_id': 'req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.202085 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83508dda4c4442dbf73fc8fefee00c7', 'request_id': 'req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.212584 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83508dda4c4442dbf73fc8fefee00c7', 'request_id': 'req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.225948 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] The token cache is being invalidate because project f83508dda4c4442dbf73fc8fefee00c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:06:05.226322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.227514 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.230172 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1416/2840] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:06:04 2022] DELETE /identity/v3/projects/f83508dda4c4442dbf73fc8fefee00c7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:05.233224 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:05.234665 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:05.250765 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3de43c-3687-4a05-8849-8ff5d07e35be admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:05.368786 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:05.369886 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:05.370305 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:05.371245 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] PATH_INFO: `/v3/users/b3ab78d0d4c144b9be2c2cfe681e4194` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:05.375144 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ab78d0d4c144b9be2c2cfe681e4194)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:05.377590 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:05.487538 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ab78d0d4c144b9be2c2cfe681e4194'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.488337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ab78d0d4c144b9be2c2cfe681e4194'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.500023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ab78d0d4c144b9be2c2cfe681e4194'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.509565 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ab78d0d4c144b9be2c2cfe681e4194'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.553262 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-3eaf20f7-9d38-47a0-9797-952fee83f45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ab78d0d4c144b9be2c2cfe681e4194'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:05.566052 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1425/2841] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:06:05 2022] DELETE /identity/v3/users/b3ab78d0d4c144b9be2c2cfe681e4194 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:05.925756 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:05.927355 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:05.949134 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d240f-ac6a-4f36-8ee9-351ee07a687c admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:06.046354 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:06.047555 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:06.048263 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:06.048776 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] PATH_INFO: `/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:06.050483 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b04698a14ba4bd3a7a99cf1c866164f)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:06.053189 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:06.123419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b04698a14ba4bd3a7a99cf1c866164f', 'request_id': 'req-ae5ba07a-c819-4256-a918-cb2568cd4708'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:06.134735 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b04698a14ba4bd3a7a99cf1c866164f', 'request_id': 'req-ae5ba07a-c819-4256-a918-cb2568cd4708'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:06.148258 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b04698a14ba4bd3a7a99cf1c866164f', 'request_id': 'req-ae5ba07a-c819-4256-a918-cb2568cd4708'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:06.171167 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] The token cache is being invalidate because project 5b04698a14ba4bd3a7a99cf1c866164f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80218) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:06:06.171458 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:06.172986 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-ae5ba07a-c819-4256-a918-cb2568cd4708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:06.187773 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1417/2842] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:06:05 2022] DELETE /identity/v3/projects/5b04698a14ba4bd3a7a99cf1c866164f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:09.653361 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:09.653857 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:09.653958 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:09.672856 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] MFA Rules not processed for user `63ae321a9c5e4bcd860d112dc9674e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:09.674073 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:09.724121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:09.736093 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1426/2843] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:11.760843 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53b0d7-1cba-422f-8dc8-3af56543c1c5 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:11.761359 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53b0d7-1cba-422f-8dc8-3af56543c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:11.761496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53b0d7-1cba-422f-8dc8-3af56543c1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:11.769552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:11.785399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-3a53b0d7-1cba-422f-8dc8-3af56543c1c5 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:11.786713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-3a53b0d7-1cba-422f-8dc8-3af56543c1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:11.845973 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1418/2844] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:11.857686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:11.859172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:11.932962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2066cc-fd0b-44da-88a2-7f2673695c41 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:11.938049 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:11.938670 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:11.938966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:11.939233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:11.948852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:11.950486 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:11.959332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1427/2845] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:06:21.837949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=24 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:21.955829 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=32 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:24.757684 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:24.758205 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:24.758318 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:24.777678 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] MFA Rules not processed for user `0cfd826d02074f01917101d893775d92`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:24.778885 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:24.844445 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1419/2846] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:31.006266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:31.007791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:31.066213 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec003a7-7d15-4964-b725-5872740bcfcd service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:31.070026 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:31.070715 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:31.070951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:31.071228 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:31.073021 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:31.138922 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:31.140419 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840375f-6698-4533-b5ce-9e2a115fb93d service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:31.155951 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1428/2847] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:06:34.634662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:34.636127 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:34.723701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3bd58-4e84-4049-9c33-6786eb591929 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:34.729370 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:34.730240 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:34.730976 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:34.731430 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:34.733726 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:34.748515 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:34.750133 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:34.765051 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1420/2848] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:06:41.146166 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=50 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:41.660636 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:41.660923 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:41.661202 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:41.694748 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:41.696017 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:41.729757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1429/2849] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 4 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:06:41.742078 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:41.785053 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf4791-0ec4-48ed-913d-dcd78dbb5989 service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:41.790122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:41.790731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:41.791009 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:41.791288 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:41.799372 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:41.800991 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91915ee-2fdc-43dd-9740-969a1f28caea service swift] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:41.809479 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1421/2850] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:06:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:06:50.295980 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:50.297396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:50.407282 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d7bb-16a1-4641-a42a-a7a1626a2b72 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:50.413438 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:50.414294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:50.414780 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:50.415053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:50.416891 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:50.429129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:50.430749 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:50.442674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1430/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:06:51.805837 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=79 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:56.379949 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:56.380608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:56.380608 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:56.411406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:56.412644 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:56.419921 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1422/2852] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:56.432102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:56.443699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a2386-0f09-4f53-a8d1-2d2bc28c2551 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:56.449380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:56.450091 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:56.450374 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:56.451138 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:56.459331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:56.460962 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:56.469844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1431/2853] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:06:58.379211 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:58.380730 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:58.476910 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864f67e-5588-4a24-a7b8-e435bd8a053a None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:58.481519 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:58.482196 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:58.482499 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:58.482759 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] PATH_INFO: `/v3/users/0cfd826d02074f01917101d893775d92` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:58.484002 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfd826d02074f01917101d893775d92)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:58.485938 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:58.535207 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfd826d02074f01917101d893775d92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.535888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfd826d02074f01917101d893775d92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.542627 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfd826d02074f01917101d893775d92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.549540 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfd826d02074f01917101d893775d92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.550213 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-010a9a0a-de6b-448e-ab16-11435b6b638c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfd826d02074f01917101d893775d92'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.566918 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1423/2854] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:06:58 2022] DELETE /identity/v3/users/0cfd826d02074f01917101d893775d92 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:58.744499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:58.756499 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd986-eeed-4f0f-81fc-25e0f2b25aa5 service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:58.814784 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:58.815488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:58.815794 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:58.816069 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] PATH_INFO: `/v3/projects/648257407546465f9f7373d1611b6b28` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:58.817211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=648257407546465f9f7373d1611b6b28)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:58.819095 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:58.835556 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=100 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:58.864455 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648257407546465f9f7373d1611b6b28', 'request_id': 'req-545db9e3-e880-4066-b94c-9d46b3cb79fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.872544 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648257407546465f9f7373d1611b6b28', 'request_id': 'req-545db9e3-e880-4066-b94c-9d46b3cb79fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.878449 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648257407546465f9f7373d1611b6b28', 'request_id': 'req-545db9e3-e880-4066-b94c-9d46b3cb79fe'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.889656 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] The token cache is being invalidate because project 648257407546465f9f7373d1611b6b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:06:58.889937 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.890562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-545db9e3-e880-4066-b94c-9d46b3cb79fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:06:58.892107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1432/2855] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:06:58 2022] DELETE /identity/v3/projects/648257407546465f9f7373d1611b6b28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:58.898590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:58.898881 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:58.899156 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:58.948701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:58.958384 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:58.960199 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:59.017191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1424/2856] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:59.025551 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.025840 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.026380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.046206 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:59.047399 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:59.055454 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1433/2857] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:59.060138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.069727 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b9fa-6f72-49ca-a2c4-b77bfcfc4d13 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.074471 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.075109 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.075391 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.075667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.076399 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:06:59.076706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.078305 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.089704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1425/2858] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:06:59.094088 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.103492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8eb11-f021-46ae-bace-eec94dca2e86 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.108699 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.109330 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.109612 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.109885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.110596 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.112533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.140560 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1434/2859] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:06:59 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:06:59.144749 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.155619 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6f087-6fe6-40ee-9094-edf478d3744e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.210688 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.211319 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.211590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.211929 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.212621 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.214565 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.235529 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1426/2860] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:06:59 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:06:59.239593 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.249999 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02d95-14ce-4e4f-9882-cc5c1275c19b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.254689 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.255280 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.255559 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.255871 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.256571 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.258176 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.268533 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1435/2861] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:06:59.272251 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.282917 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2beda9-0f4f-4734-b77d-1113d5b97459 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.287500 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.288128 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.288416 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.288691 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.289380 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.291246 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca054f-a378-4694-8d57-0f65f41791ee admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.301841 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1427/2862] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:06:59.305944 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.316092 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94910f-ee78-4d4e-9871-dfd029f62528 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.320756 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.321406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.321686 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.321960 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] PATH_INFO: `/v3/projects/03dbb153863d41169ae215ce77573cf3/users/e5a7a902eb63462b851389595fd91a9b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.336979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dbb153863d41169ae215ce77573cf3, user_id=e5a7a902eb63462b851389595fd91a9b, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.339610 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.353268 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1436/2863] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:06:59 2022] PUT /identity/v3/projects/03dbb153863d41169ae215ce77573cf3/users/e5a7a902eb63462b851389595fd91a9b/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:06:59.363157 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.363475 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.363858 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.392322 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] MFA Rules not processed for user `e5a7a902eb63462b851389595fd91a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:06:59.393553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:59.454592 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:06:59.459000 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1428/2864] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:06:59.470129 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:06:59.471861 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:06:59.529710 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef8e47-1503-45eb-9a3f-db4708244aeb admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:06:59.533255 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9af670ced484a8c829f245bd08ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:06:59.533868 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:06:59.534151 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:06:59.534426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:06:59.542808 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:06:59.544297 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fadae6-50e9-42e3-80ba-e098248174f1 service cinder] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:06:59.553337 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1437/2865] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:07:04.521422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:07:04.583574 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afb7ed-7747-4384-8684-e4db93966e32 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:07:04.588092 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:07:04.588731 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:07:04.589017 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:07:04.589299 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] PATH_INFO: `/v3/users/e5a7a902eb63462b851389595fd91a9b` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:07:04.590553 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a7a902eb63462b851389595fd91a9b)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:07:04.592533 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:07:04.638378 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a7a902eb63462b851389595fd91a9b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:04.639031 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a7a902eb63462b851389595fd91a9b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:04.645883 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a7a902eb63462b851389595fd91a9b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:04.653806 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a7a902eb63462b851389595fd91a9b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:04.654539 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a7a902eb63462b851389595fd91a9b'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:04.672029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1429/2866] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:07:04 2022] DELETE /identity/v3/users/e5a7a902eb63462b851389595fd91a9b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:07:04.676708 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:07:04.677246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:07:04.677246 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:07:04.696219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:07:04.697410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:07:04.737124 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:04.757051 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1438/2867] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:07:04.766613 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:07:04.768024 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:07:04.845611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938daf-55da-472a-9c82-2b1e018b4202 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:07:04.849316 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:07:04.849931 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:07:04.850209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:07:04.850481 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:07:04.859979 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:07:04.861406 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aced6-dd17-4420-9ad7-8eb2d1fd882b service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:07:04.871086 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1430/2868] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:07:05.134473 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:07:05.136184 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:07:05.151132 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a49daa-dcfd-48a2-9f71-80816f6613d0 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:07:05.157622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:07:05.158302 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:07:05.158562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:07:05.158850 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] PATH_INFO: `/v3/projects/03dbb153863d41169ae215ce77573cf3` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:07:05.160097 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dbb153863d41169ae215ce77573cf3)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:07:05.161983 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:07:05.209757 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dbb153863d41169ae215ce77573cf3', 'request_id': 'req-a682738b-f8df-423e-a131-9f668d124f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:05.216882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dbb153863d41169ae215ce77573cf3', 'request_id': 'req-a682738b-f8df-423e-a131-9f668d124f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:05.222547 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dbb153863d41169ae215ce77573cf3', 'request_id': 'req-a682738b-f8df-423e-a131-9f668d124f85'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:05.233437 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] The token cache is being invalidate because project 03dbb153863d41169ae215ce77573cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:07:05.233719 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:05.234336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:07:05.235846 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1439/2869] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:07:05 2022] DELETE /identity/v3/projects/03dbb153863d41169ae215ce77573cf3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:07:14.866590 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:07:15.230464 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:04.605747 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:04.606229 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:04.606335 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:04.625900 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] MFA Rules not processed for user `a720e28d18904eacaf37c162a398c288`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:04.627119 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:04.683326 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1431/2870] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 4 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:04.729219 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:04.730623 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:04.799579 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682738b-f8df-423e-a131-9f668d124f85 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:04.805314 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc7e41de613b48f9a9cb7e0a5ceb0aa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:04.805928 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:04.806212 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:04.806488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:04.814824 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:04.816448 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:04.824468 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1440/2871] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 4 21:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 21:08:11.359859 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:11.361489 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:11.442907 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588866c-3ab4-4290-8b64-09de9688ae67 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:11.449066 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:11.449721 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:11.450004 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:11.450698 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] PATH_INFO: `/v3/users/63ae321a9c5e4bcd860d112dc9674e02` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:11.451965 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ae321a9c5e4bcd860d112dc9674e02)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:11.453911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:11.514707 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ae321a9c5e4bcd860d112dc9674e02'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.515549 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ae321a9c5e4bcd860d112dc9674e02'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.523423 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ae321a9c5e4bcd860d112dc9674e02'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.532115 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ae321a9c5e4bcd860d112dc9674e02'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.532770 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ae321a9c5e4bcd860d112dc9674e02'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.552327 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1432/2872] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:08:11 2022] DELETE /identity/v3/users/63ae321a9c5e4bcd860d112dc9674e02 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:08:11.730562 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:11.743086 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d1bff-ed86-4f5b-8a76-4aa84c6ffebd service swift] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:11.803383 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:11.804056 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:11.804339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:11.804622 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] PATH_INFO: `/v3/projects/69d6bcdc73de4a058940c57824c1832e` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:11.805778 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d6bcdc73de4a058940c57824c1832e)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:11.807723 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:11.852844 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d6bcdc73de4a058940c57824c1832e', 'request_id': 'req-80376496-fc81-49b6-8d1c-80945b777f0f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.859956 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d6bcdc73de4a058940c57824c1832e', 'request_id': 'req-80376496-fc81-49b6-8d1c-80945b777f0f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.865531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d6bcdc73de4a058940c57824c1832e', 'request_id': 'req-80376496-fc81-49b6-8d1c-80945b777f0f'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.876207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] The token cache is being invalidate because project 69d6bcdc73de4a058940c57824c1832e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:08:11.876493 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.877142 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:11.878644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1441/2873] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:08:11 2022] DELETE /identity/v3/projects/69d6bcdc73de4a058940c57824c1832e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:08:11.882659 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:11.884129 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:11.897648 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785851-f89d-4e80-9d76-47a141eadca0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:11.917785 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:11.955019 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:11.955653 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:11.955968 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:11.956247 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] PATH_INFO: `/v3/users/e8159a0947404bda8a3056e22718e211` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:11.957978 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8159a0947404bda8a3056e22718e211)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:11.959952 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.005605 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8159a0947404bda8a3056e22718e211'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.006183 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8159a0947404bda8a3056e22718e211'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.014214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8159a0947404bda8a3056e22718e211'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.022408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8159a0947404bda8a3056e22718e211'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.023033 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c340ba81-da85-4605-a4dc-2e7d4c653a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8159a0947404bda8a3056e22718e211'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.040963 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1433/2874] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:08:11 2022] DELETE /identity/v3/users/e8159a0947404bda8a3056e22718e211 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:08:12.212465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.213916 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.227147 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80376496-fc81-49b6-8d1c-80945b777f0f admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.245582 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:12.289380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.289971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.290251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.290532 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] PATH_INFO: `/v3/projects/f008bf83e92e4840a049651e19ff0b74` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.291692 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f008bf83e92e4840a049651e19ff0b74)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.293609 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.339222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f008bf83e92e4840a049651e19ff0b74', 'request_id': 'req-f1c709f2-7be8-4b7d-92a2-c5708a01f672'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.345828 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f008bf83e92e4840a049651e19ff0b74', 'request_id': 'req-f1c709f2-7be8-4b7d-92a2-c5708a01f672'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.352068 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f008bf83e92e4840a049651e19ff0b74', 'request_id': 'req-f1c709f2-7be8-4b7d-92a2-c5708a01f672'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.363024 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] The token cache is being invalidate because project f008bf83e92e4840a049651e19ff0b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:08:12.363333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.363991 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-f1c709f2-7be8-4b7d-92a2-c5708a01f672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:08:12.365481 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1442/2875] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:08:12 2022] DELETE /identity/v3/projects/f008bf83e92e4840a049651e19ff0b74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:08:12.370487 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.370977 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.371094 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.390331 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:12.391516 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.449845 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1434/2876] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:12.458222 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.458510 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.458791 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.478777 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:12.480002 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.487817 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1443/2877] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 21:08:12.492105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.501967 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3b62-6aa7-485b-8d0d-277a56d61ebb None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.506524 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.507138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.507424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.507704 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.508439 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80218) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 21:08:12.508748 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.510407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.522611 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1435/2878] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 21:08:12.527131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.536971 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14090-2920-4d9f-855a-f0befeb5c19f None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.541642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.542191 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.542470 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.542745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.543407 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.545339 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.572332 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1444/2879] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:08:12.576398 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.586789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f6db-a447-4321-b621-599d32dad589 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.615587 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:12.643814 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.644424 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.645191 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.645461 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.646122 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.648049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.668203 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1436/2880] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:08:12.672293 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.685237 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba01cce-6a0b-4605-82ae-046ad98dbb9b admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.692525 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.693156 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.693543 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.693775 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.694410 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.696171 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.708477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1445/2881] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:08:12.712496 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.722898 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631e4b6-036c-4c44-81c7-50f49e9230f0 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.729552 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.730269 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.730663 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.730943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.731642 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.733296 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4dbb7-207d-47aa-81c5-0b5c602ce953 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.744720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1437/2882] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:08:12.748981 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.759535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866409e1-0d61-4ac6-a8b0-cf1e3703189d admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.764080 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.764732 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.765007 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.765278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] PATH_INFO: `/v3/projects/f082cce9811f45fd91d573ab4b68703b/users/786d68e87996464f9de3b8368d8249df/roles/9ef2e5b4300a4890ba2e2f7d9411f97f` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.780495 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f082cce9811f45fd91d573ab4b68703b, user_id=786d68e87996464f9de3b8368d8249df, role_id=9ef2e5b4300a4890ba2e2f7d9411f97f)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.783121 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.795456 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1446/2883] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:08:12 2022] PUT /identity/v3/projects/f082cce9811f45fd91d573ab4b68703b/users/786d68e87996464f9de3b8368d8249df/roles/9ef2e5b4300a4890ba2e2f7d9411f97f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:08:12.800538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf091-3beb-4120-a68f-c3aa5afafd64 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.800827 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf091-3beb-4120-a68f-c3aa5afafd64 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.801101 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bf091-3beb-4120-a68f-c3aa5afafd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.821337 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-c91bf091-3beb-4120-a68f-c3aa5afafd64 None None] MFA Rules not processed for user `324f5132b96b4ed6a03451226e91b982`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:12.822538 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c91bf091-3beb-4120-a68f-c3aa5afafd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.883681 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1438/2884] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:12.893162 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:12.895514 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:12.946833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:12.952107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a28c6-cc20-4e8d-ac83-81d076974ca7 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:12.957763 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:12.958641 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:12.959102 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:12.959575 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:12.968745 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:12.970207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:12.979683 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1447/2885] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:08:16.758667 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:16.759150 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:16.759252 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:16.790422 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.auth.core [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] MFA Rules not processed for user `786d68e87996464f9de3b8368d8249df`. Rule list: `[]` (Enabled: `True`). {{(pid=80218) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:16.791966 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:16.860789 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1439/2886] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:16.865969 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:16.876115 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d751-0fce-4cf8-a9d3-e57032d279a0 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:16.881418 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:16.881979 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:16.882260 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:16.882537 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:16.883227 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:16.885285 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:16.919106 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1448/2887] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 4 21:08:16 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:08:16.920418 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:16.932166 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcde76-0443-4a18-b2ea-cfb76264f8e9 None None] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:16.971801 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:16.993064 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:16.993700 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] REQUEST_METHOD: `POST` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:16.993987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:16.994265 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] PATH_INFO: `/v3/users` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:16.994943 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:16.996997 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.019717 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1440/2888] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 4 21:08:16 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 21:08:17.023521 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.034488 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840532d6-3497-4ab8-8367-1092d622c600 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.039242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.039910 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.040194 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.040471 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.041169 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:17.042779 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.054889 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1449/2889] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 21:08:17.059105 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.070181 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f39c4-b8a1-477b-97a3-999c8c1af992 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.075282 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.076010 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.076292 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.076569 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] PATH_INFO: `/v3/projects/f22a527612ba4391b4b2f782b406e75a/users/38a6a07d2846479bb7214c75acaeb652/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.092792 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22a527612ba4391b4b2f782b406e75a, user_id=38a6a07d2846479bb7214c75acaeb652, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:17.095729 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.109164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1441/2890] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:08:17 2022] PUT /identity/v3/projects/f22a527612ba4391b4b2f782b406e75a/users/38a6a07d2846479bb7214c75acaeb652/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:08:17.112995 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.123642 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc8907-de6d-41a5-8804-bbf863af86c1 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.182698 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.183326 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.183608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.183924 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.184626 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:17.186278 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9eea-4003-49e8-939e-1ab0a48827a3 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.197492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1450/2891] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 4 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 21:08:17.201633 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:17.212162 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176a617-cc55-4afb-87d5-32d05299dad3 admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:17.216711 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:17.217363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:17.217641 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:17.217913 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] PATH_INFO: `/v3/projects/f22a527612ba4391b4b2f782b406e75a/users/38a6a07d2846479bb7214c75acaeb652/roles/c757366a629b447b93eff207471f3401` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:17.219857 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22a527612ba4391b4b2f782b406e75a, user_id=38a6a07d2846479bb7214c75acaeb652, role_id=c757366a629b447b93eff207471f3401)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:17.222465 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:17.233045 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1442/2892] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 4 21:08:17 2022] PUT /identity/v3/projects/f22a527612ba4391b4b2f782b406e75a/users/38a6a07d2846479bb7214c75acaeb652/roles/c757366a629b447b93eff207471f3401 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:08:21.873209 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf369dd-32d5-4b8d-98e4-75f9b113a527 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:21.874078 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf369dd-32d5-4b8d-98e4-75f9b113a527 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:21.874535 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf369dd-32d5-4b8d-98e4-75f9b113a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:21.909000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-fdf369dd-32d5-4b8d-98e4-75f9b113a527 None None] MFA Rules not processed for user `38a6a07d2846479bb7214c75acaeb652`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:21.910820 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-fdf369dd-32d5-4b8d-98e4-75f9b113a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:21.993061 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1451/2893] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:22.006849 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:22.008626 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:22.125149 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e67be8-4b1a-4f12-876b-f4d1ec43d5ac admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:22.131055 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:22.131786 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:22.132148 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:22.132435 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:22.205720 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:22.207911 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:22.216701 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1443/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:08:23.190833 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] REQUEST_METHOD: `POST` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:23.192023 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:23.192113 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:23.212649 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.auth.core [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] MFA Rules not processed for user `786d68e87996464f9de3b8368d8249df`. Rule list: `[]` (Enabled: `True`). {{(pid=80217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 21:08:23.213865 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:23.220724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1452/2895] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 4 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 21:08:32.212757 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:33.207616 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:38.191138 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:38.192624 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:38.264462 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c2b9e-73de-489d-81b4-a6ab1e99904f service nova] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:38.269723 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:38.270530 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:38.270817 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:38.271097 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:38.272927 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:38.288819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:38.291591 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:38.305880 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1444/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:08:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:08:40.596426 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:40.607266 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8d02c-5179-44af-bf55-fdf294c85c45 None None] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:40.610866 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:40.611469 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:40.611762 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:40.612040 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:40.613874 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:08:40.628225 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:40.629664 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:40.641251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1453/2897] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:08:46.803143 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:08:46.812320 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acf91f-1062-4db4-acfe-6ad32a2204cb service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:08:46.815872 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:08:46.816473 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:08:46.816752 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:08:46.817030 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:08:46.826415 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:08:46.827879 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:08:46.837049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1445/2898] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:08:50.636053 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:08:56.832964 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=32 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:09:56.995207 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:09:57.003959 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc955a68-6992-4c37-bd99-5a0b5643cf8f service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:09:57.007548 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:09:57.008187 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:09:57.008492 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:09:57.008769 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:09:57.010504 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:09:57.020465 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:09:57.021885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:09:57.030211 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1454/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:09:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:10:07.026234 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:10:56.205377 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:10:56.215071 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6006f10-e2d1-40e5-beba-14b3284daa92 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:10:56.218904 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:10:56.219476 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:10:56.219777 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:10:56.220067 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:10:56.222266 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:10:56.233689 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:10:56.235227 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:10:56.244216 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1446/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:10:56.345853 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:10:56.355281 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0731a-a33e-4854-a7d9-705ab8fea354 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:10:56.358935 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffeab70f281f498cad508880727ca637', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:10:56.359545 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:10:56.359852 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:10:56.360131 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:10:56.361917 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:10:56.375685 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:10:56.377306 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:10:56.388333 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1455/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 21:10:56.462261 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:10:56.463716 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:10:56.535912 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dafb67-c564-4855-b620-3597b5f6d131 service neutron] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:10:56.540909 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:10:56.541525 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:10:56.541803 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:10:56.542074 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:10:56.543832 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:10:56.554819 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:10:56.556441 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:10:56.566408 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1447/2902] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:11:00.407349 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:11:00.408804 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:11:00.425759 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7606d3-b587-42d5-b181-604f0c9bd187 service neutron] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:11:00.432181 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:11:00.432968 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:11:00.433291 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:11:00.433570 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:11:00.435406 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:11:00.448172 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:11:00.449975 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:11:00.461608 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1456/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:11:06.566807 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=38 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:11:10.456423 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=12 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:11:56.293070 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:11:56.303570 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279fd39-4675-486e-9ac2-5e52b381c764 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:11:56.308610 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:11:56.309214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:11:56.309585 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:11:56.309888 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:11:56.311618 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:11:56.323662 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:11:56.325281 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:11:56.335622 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1448/2904] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:12:06.330891 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=6 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:12:11.693620 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:11.705382 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1345-1eb4-447e-9c69-f91adacef9cd service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:11.712445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff966e741314bb8b510713bff46a08c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:11.713531 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:11.713885 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:11.714223 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:11.716251 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:12:11.732319 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:11.734380 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:11.747864 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1457/2905] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:12:18.681054 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:18.693131 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bba5d-9e87-41b9-b7db-4affff9889a5 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:18.707363 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:18.708028 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:18.708312 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:18.708595 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:18.710383 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:12:18.723420 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:18.725012 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:18.737209 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1449/2906] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:12:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:12:21.741966 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=6 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:12:21.836445 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:21.849100 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f6907-5d84-40ee-b78b-18d03bbb1849 service nova] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:21.855354 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:21.856006 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] REQUEST_METHOD: `GET` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:21.856284 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:21.856555 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:21.858451 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:12:21.874154 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:21.880644 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:21.893150 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1458/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:12:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:12:21.907640 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:21.973419 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f147c1-e769-4e76-a446-e6cb94bc9760 service placement] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:21.977797 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:21.978427 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:21.978706 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:21.978987 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] PATH_INFO: `/v3/users/786d68e87996464f9de3b8368d8249df` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:21.980164 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=786d68e87996464f9de3b8368d8249df)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:21.982072 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:22.027289 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786d68e87996464f9de3b8368d8249df'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.027962 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786d68e87996464f9de3b8368d8249df'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.034713 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786d68e87996464f9de3b8368d8249df'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.041920 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786d68e87996464f9de3b8368d8249df'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.042568 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786d68e87996464f9de3b8368d8249df'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.060142 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1450/2908] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:12:21 2022] DELETE /identity/v3/users/786d68e87996464f9de3b8368d8249df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:12:22.233855 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:22.244882 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea90ad-4bf8-4a6d-a4f7-462b8e4aa0a4 service placement] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:22.305167 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:22.305814 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:22.306117 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:22.306396 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] PATH_INFO: `/v3/projects/f082cce9811f45fd91d573ab4b68703b` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:22.307539 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f082cce9811f45fd91d573ab4b68703b)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:22.309477 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:22.354064 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f082cce9811f45fd91d573ab4b68703b', 'request_id': 'req-e473175e-7f16-4b15-ac14-0d205a709c21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.360854 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f082cce9811f45fd91d573ab4b68703b', 'request_id': 'req-e473175e-7f16-4b15-ac14-0d205a709c21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.367233 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f082cce9811f45fd91d573ab4b68703b', 'request_id': 'req-e473175e-7f16-4b15-ac14-0d205a709c21'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.378107 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] The token cache is being invalidate because project f082cce9811f45fd91d573ab4b68703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:12:22.378998 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.379674 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.381242 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1459/2909] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:12:22 2022] DELETE /identity/v3/projects/f082cce9811f45fd91d573ab4b68703b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 21:12:22.385407 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:22.386812 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:12:22.401596 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955336-083a-4dc5-87af-fb200dcacedf admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:22.456271 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:22.458220 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:22.458497 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:22.458768 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] PATH_INFO: `/v3/users/38a6a07d2846479bb7214c75acaeb652` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:22.459990 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a6a07d2846479bb7214c75acaeb652)` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:22.461956 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:22.467871 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:12:22.509901 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a6a07d2846479bb7214c75acaeb652'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.510469 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a6a07d2846479bb7214c75acaeb652'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.517214 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a6a07d2846479bb7214c75acaeb652'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.525096 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a6a07d2846479bb7214c75acaeb652'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.526328 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.notifications [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a6a07d2846479bb7214c75acaeb652'} {{(pid=80218) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.548437 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1451/2910] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 4 21:12:22 2022] DELETE /identity/v3/users/38a6a07d2846479bb7214c75acaeb652 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:12:22.721336 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Authenticating user token {{(pid=80217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:12:22.722766 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.fernet_utils [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:12:22.735149 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473175e-7f16-4b15-ac14-0d205a709c21 admin admin] Validating token access rules against request {{(pid=80217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:12:22.792363 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '324f5132b96b4ed6a03451226e91b982', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e33293e6de544d599e97bfb77454f460', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:12:22.792976 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:12:22.793216 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:12:22.793500 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] PATH_INFO: `/v3/projects/f22a527612ba4391b4b2f782b406e75a` {{(pid=80217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:12:22.794716 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22a527612ba4391b4b2f782b406e75a)` {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:12:22.796724 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] RBAC: Authorization granted {{(pid=80217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:12:22.819000 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:12:22.843879 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22a527612ba4391b4b2f782b406e75a', 'request_id': 'req-32917052-3542-437a-ae1e-d74746665403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.851186 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22a527612ba4391b4b2f782b406e75a', 'request_id': 'req-32917052-3542-437a-ae1e-d74746665403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.856903 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22a527612ba4391b4b2f782b406e75a', 'request_id': 'req-32917052-3542-437a-ae1e-d74746665403'} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.868296 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] The token cache is being invalidate because project f22a527612ba4391b4b2f782b406e75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 21:12:22.868585 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.869294 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG keystone.notifications [None req-32917052-3542-437a-ae1e-d74746665403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 21:12:22.870744 dv-cinder-836027-4-smb devstack@keystone.service[80217]: [pid: 80217|app: 0|req: 1460/2911] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 4 21:12:22 2022] DELETE /identity/v3/projects/f22a527612ba4391b4b2f782b406e75a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 21:12:32.542934 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:12:32.865331 dv-cinder-836027-4-smb devstack@keystone.service[80217]: DEBUG dbcounter [-] [80217] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 21:16:58.302919 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Authenticating user token {{(pid=80218) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 21:16:58.304351 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.442368 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1bc34-6972-4939-95a9-cbac93b7c53e admin admin] Validating token access rules against request {{(pid=80218) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 21:16:58.500126 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a01a4b3ff4334746912df78fae4e2fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07a821ba84e54000a2644d4fb218866a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80218) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 21:16:58.500743 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] REQUEST_METHOD: `GET` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 21:16:58.501029 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] SCRIPT_NAME: `/identity` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 21:16:58.501304 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80218) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 21:16:58.503049 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.fernet_utils [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80218) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 21:16:58.514040 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 21:16:58.515643 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad58c0-4e5c-4ed4-b84a-127e04108691 service placement] RBAC: Authorization granted {{(pid=80218) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 21:16:58.525683 dv-cinder-836027-4-smb devstack@keystone.service[80218]: [pid: 80218|app: 0|req: 1452/2912] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 4 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 21:17:08.521113 dv-cinder-836027-4-smb devstack@keystone.service[80218]: DEBUG dbcounter [-] [80218] Writing DB stats keystone:SELECT=89 {{(pid=80218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}